-- Logs begin at Thu 2022-06-16 19:16:30 UTC, end at Thu 2022-06-16 20:55:59 UTC. -- Jun 16 20:13:23.491101 dv-cinder-819149-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 20:13:23.498999 dv-cinder-819149-6-smb devstack@keystone.service[80407]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 20:13:23 2022] *** Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: nodename: dv-cinder-819149-6-smb Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: machine: x86_64 Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: clock source: unix Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: pcre jit disabled Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: detected number of CPU cores: 4 Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: current working directory: / Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: detected binary path: /usr/bin/uwsgi-core Jun 16 20:13:23.502057 dv-cinder-819149-6-smb devstack@keystone.service[80407]: your processes number limit is 47680 Jun 16 20:13:23.502670 dv-cinder-819149-6-smb devstack@keystone.service[80407]: your memory page size is 4096 bytes Jun 16 20:13:23.502670 dv-cinder-819149-6-smb devstack@keystone.service[80407]: detected max file descriptor number: 2048 Jun 16 20:13:23.502670 dv-cinder-819149-6-smb devstack@keystone.service[80407]: lock engine: pthread robust mutexes Jun 16 20:13:23.502670 dv-cinder-819149-6-smb devstack@keystone.service[80407]: thunder lock: enabled Jun 16 20:13:23.502670 dv-cinder-819149-6-smb devstack@keystone.service[80407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 20:13:23.502670 dv-cinder-819149-6-smb devstack@keystone.service[80407]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 20:13:23.546494 dv-cinder-819149-6-smb devstack@keystone.service[80407]: Python main interpreter initialized at 0x557c346ea9c0 Jun 16 20:13:23.546494 dv-cinder-819149-6-smb devstack@keystone.service[80407]: python threads support enabled Jun 16 20:13:23.546494 dv-cinder-819149-6-smb devstack@keystone.service[80407]: your server socket listen backlog is limited to 100 connections Jun 16 20:13:23.546753 dv-cinder-819149-6-smb devstack@keystone.service[80407]: your mercy for graceful operations on workers is 90 seconds Jun 16 20:13:23.546832 dv-cinder-819149-6-smb devstack@keystone.service[80407]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 20:13:23.546930 dv-cinder-819149-6-smb devstack@keystone.service[80407]: *** Operational MODE: preforking *** Jun 16 20:13:23.547211 dv-cinder-819149-6-smb devstack@keystone.service[80407]: *** uWSGI is running in multiple interpreter mode *** Jun 16 20:13:23.547211 dv-cinder-819149-6-smb devstack@keystone.service[80407]: spawned uWSGI master process (pid: 80407) Jun 16 20:13:23.547413 dv-cinder-819149-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 16 20:13:23.552653 dv-cinder-819149-6-smb devstack@keystone.service[80407]: spawned uWSGI worker 1 (pid: 80421, cores: 1) Jun 16 20:13:23.552653 dv-cinder-819149-6-smb devstack@keystone.service[80407]: spawned uWSGI worker 2 (pid: 80422, cores: 1) Jun 16 20:13:23.552653 dv-cinder-819149-6-smb devstack@keystone.service[80407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 20:13:29.069334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:13:29.069334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: from cryptography.utils import int_from_bytes Jun 16 20:13:29.070149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:13:29.070149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: from cryptography.utils import int_from_bytes Jun 16 20:13:29.103584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:13:29.103584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: from cryptography.utils import int_from_bytes Jun 16 20:13:29.104080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 20:13:29.104080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: from cryptography.utils import int_from_bytes Jun 16 20:13:29.120100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] command line args: [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ================================================================================ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] admin_token = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] config_dir = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] config_source = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.126540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] debug = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_config_append = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_dir = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.127966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] publish_errors = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.128883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.129171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.129283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] standard_threads = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.129515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.129759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.129937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.130114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] use_journal = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.130293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] use_json = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.130469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] use_stderr = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.130646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] use_syslog = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.130877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.131132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.131370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.131630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.131885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.132149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.132391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.132661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.132902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.133151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.133398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.133654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.133886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.134132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.134367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.134614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.134861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.135098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.135350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.135603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.135848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.136084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.136338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.136600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.136876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.137124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.137356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.137586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.137822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.138060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.138307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.138556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.138789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.139022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.139269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.139518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.139757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.140005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.140237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.140474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.140805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.141041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.141274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.141507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.141739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.141977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.142231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.142470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.142709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.142942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.143178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.143414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.143663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.143894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.144131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.144368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.144606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.144865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.145102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.145332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.145579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.145815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.146051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.146283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.146542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.146778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.147009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.147246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.147481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.148280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.148519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.148800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.149047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.149282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.149517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.149754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.150002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.150239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.150474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.150716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.150952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.151189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.151425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.151661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.151896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.152158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.152398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.152476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 20:13:29.152601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 20:13:29.152715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.152823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] command line args: [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 20:13:29.152903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.153106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 20:13:29.153262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.153343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ================================================================================ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 20:13:29.153416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.153536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] admin_token = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.153622 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.153781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.153867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config_dir = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.153970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.154046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.154154 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] config_source = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.154237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.154333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] debug = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.154446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.154526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.154682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.154762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.154913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.155001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.155155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.155235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.155392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.155470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.155641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.155731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.155805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_config_append = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.155878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.155985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.156121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.156199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_dir = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.156331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.156409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.156570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.156680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.156845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.156923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.external = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.157076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.157187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.157331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.157417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.157512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.157603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.157678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.157814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.password = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.157926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.158046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] auth.token = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.158159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.158288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.158395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.158526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.158643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.158757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.158869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.158975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.159057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.159225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.159309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.159474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.159556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.159705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.159803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.159941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.160185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.160264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.160417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] publish_errors = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.160546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.160658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.160734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.160899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.160992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.161118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.161196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.161317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.161398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.161554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.161636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.161790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] standard_threads = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.161871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.162011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.162111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.162256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.162345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.162427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.162588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.162668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_journal = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.162785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_json = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.162866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.162979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_stderr = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.163106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] use_syslog = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.163223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.163879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.163963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 20:13:29.164138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.164959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.165909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.166881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.167848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.168977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.169935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.170971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.171924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.172936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.173891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.174992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.175995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176634 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.176965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.177900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.178050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.178129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.178294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.178375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.178527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.178606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.179971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.180967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.181987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.182919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.183877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.185933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.186945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.187883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.188871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.external = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.189982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.password = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] auth.token = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.190925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] role.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] role.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.191973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.192948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.193897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.194978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.195968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.196955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.197894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198136 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.198857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.199951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.200938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.201973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.202927 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203316 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.203916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.204881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.205890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.206975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.207995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.208143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.208223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.208319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80422) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 20:13:29.208401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.208604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.208863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.209103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.209352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.209601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.209839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.210606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.210859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.211110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.211349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.211587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.211825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.212058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.212302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.212567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.212827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.213078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.213327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.213576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.213814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.214046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.214284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.214521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.214758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.214991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.215239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.215488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.215735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.215982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.216228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.216459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.216730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.216970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.217208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.217445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.217681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.217928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.218180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.218418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.218674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.218906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.219151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.219388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.219624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.219862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.220109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.220359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.220593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.220855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.221099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.221351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.221603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.221842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.222094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.222349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.222589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.222839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.223077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.223319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.223556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.223806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.224040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.224292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.224542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.224817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.225068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.225317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.225564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.225882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.226133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.226370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.226620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.226869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.227118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.227366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.227811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.228052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.228304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.228554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.228831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.229084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.229322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.229581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.229834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.230076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.230316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.230550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.230784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.231037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.231292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.231543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.231782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.232019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.232253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.232491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.232754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.233007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.233247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.233507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.233758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.233999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.234248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.234495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.234746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.234986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.235228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.235465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.235713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.235966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.236198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.236446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.236789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.237056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.237307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.237557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.237798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.238044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.238284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.238526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.238764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.239004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.239253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.239494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.239743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.239982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.240240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.240480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.240753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.240988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.241753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.242192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 20:13:29.242375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80421) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 20:13:29.324875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.325064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.325235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.334033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.350948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.351174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.351400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.359831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.361872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.362107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.378446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.378680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.415899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.416811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.466723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.466882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.466954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.467050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.532662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.532872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.532965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.533948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.557642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.557880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.557998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.558956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.559048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.559167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.570550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.570699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.583911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80422) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.584766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80421) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 20:13:29.601987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.602194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:13:29.602280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.602438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:13:29.602544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.602719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:13:29.602801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.602953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 20:13:29.603035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.603974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.614540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.614815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.614897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.615077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.615171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.615341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.615424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.615619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.623606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.623820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.626896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.627127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.627210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.627398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.627482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.627673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.627758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.627946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.628833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.629785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.656405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.656558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.658037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.658175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.658312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.658449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.664081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.664217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.664471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.664567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.664786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.664871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.672146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.672270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.672424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.672551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.676925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.677014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.677212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.677295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.677492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.677576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.677770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.677860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.678042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.678134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.678307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.678388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.678578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.679613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.679746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.679885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.698249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.698371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.698521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.698649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.703061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.703207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.706780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.706881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.707069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.707270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.712165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.712356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.715768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.716045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.719550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.719707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.719844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.720943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.721145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.740346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.740647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.740743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.740906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.740989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.741199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.741886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.742060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.749564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.749987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.751257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.751525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.751696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.751977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.755952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.756228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.756438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.756520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.756740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.756838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.757058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.757141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.757347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.757622 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.770228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.770500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.770773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.770892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.771046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.771169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.771325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.771445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.771688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.771776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.771962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.772050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.772324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.772640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.790256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.791004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.793506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.794270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.796784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.797608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.798502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.799338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.800132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.800403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.800698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.801002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.801278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.801567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.808757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.809653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.810406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.811271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.813643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.813926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.814308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.814508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.814607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.814794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.815181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.815463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.823840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.824130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.824401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.824655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.824940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.825214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.832281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80421) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.832557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.832853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.833090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80422) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 20:13:29.833218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.833368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.833464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.833647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.833757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.833917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.834916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80421) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.835998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.836182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.836444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.836726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80422) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 20:13:29.874931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c346ea9c0 pid: 80421 (default app) Jun 16 20:13:29.875168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557c346ea9c0 pid: 80422 (default app) Jun 16 20:13:29.878278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a973e0b-5151-46af-95d6-49aba8ea6095 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:29.878569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a973e0b-5151-46af-95d6-49aba8ea6095 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:29.878841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a973e0b-5151-46af-95d6-49aba8ea6095 None None] PATH_INFO: `/v3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:29.883079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Thu Jun 16 20:13:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:38.953611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:38.954156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:38.954156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:38.958454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:13:38.963663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:38.964054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:38.964216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:39.032890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: INFO dbcounter [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] Registered counter for database keystone Jun 16 20:13:39.054224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG oslo_db.sqlalchemy.engines [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80421) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 20:13:39.060432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writer thread running {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 20:13:39.234593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG passlib.handlers.bcrypt [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80421) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 20:13:39.234931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG passlib.handlers.bcrypt [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80421) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 20:13:39.289232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:39.290838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:39.409912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 16 20:13:39.565997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:39.635821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: INFO dbcounter [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] Registered counter for database keystone Jun 16 20:13:39.736000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG oslo_db.sqlalchemy.engines [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80422) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 20:13:39.736000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writer thread running {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 20:13:39.780956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53e66-e477-4db3-b0e5-c5c1e512b6ad None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:39.785301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:39.786680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:39.786977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:39.787857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:39.807288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:39.848269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING keystone.common.rbac_enforcer.enforcer [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 20:13:39.848603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daeb54-ab12-40bf-af58-7b8cd322ebd3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:39.858597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Jun 16 20:13:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:13:39.864594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:39.881082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d17ffc-9ee2-4af0-b8f9-c36f89f0782f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:39.885527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:39.886608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:39.886893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:39.887171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] PATH_INFO: `/v3/projects/e6923572ff9f4b66867148d1a4dea898` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:39.888691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] RBAC: Authorizing `identity:get_project(project_id=e6923572ff9f4b66867148d1a4dea898)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:39.939878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 20:13:39.940219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49380d-2d4d-45d9-ae60-3e64b124ec9d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:39.944871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Thu Jun 16 20:13:39 2022] GET /identity/v3/projects/e6923572ff9f4b66867148d1a4dea898 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:42.012049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46520e-a3d6-4527-a391-87fadfb84be4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:42.012561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46520e-a3d6-4527-a391-87fadfb84be4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:42.012667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46520e-a3d6-4527-a391-87fadfb84be4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:42.016691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:42.022506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:42.022905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:42.023065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:42.041829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:42.043363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:42.051147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 20:13:42.073453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46520e-a3d6-4527-a391-87fadfb84be4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:42.086737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46520e-a3d6-4527-a391-87fadfb84be4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:42.091149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1f59c-45a5-45b4-b557-5b6e47cea066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:42.091789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f59c-45a5-45b4-b557-5b6e47cea066 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:42.092069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f59c-45a5-45b4-b557-5b6e47cea066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:42.092340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f59c-45a5-45b4-b557-5b6e47cea066 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:42.100735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1f59c-45a5-45b4-b557-5b6e47cea066 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:42.102490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1f59c-45a5-45b4-b557-5b6e47cea066 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:42.111388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Thu Jun 16 20:13:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:13:42.117057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:42.125953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6d38c-8ec3-41cc-95d2-e2df578d201e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:42.130288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347848c9-8f8c-429e-8de3-f44d699e128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:42.131143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347848c9-8f8c-429e-8de3-f44d699e128d admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:42.131426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347848c9-8f8c-429e-8de3-f44d699e128d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:42.131696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347848c9-8f8c-429e-8de3-f44d699e128d admin admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:42.133094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347848c9-8f8c-429e-8de3-f44d699e128d admin admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:42.134894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347848c9-8f8c-429e-8de3-f44d699e128d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:42.136440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Thu Jun 16 20:13:42 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:44.305324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347655e-118c-40e1-a0c0-f95e2357e914 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.305861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347655e-118c-40e1-a0c0-f95e2357e914 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.305952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347655e-118c-40e1-a0c0-f95e2357e914 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.307243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:13:44.312454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.312871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.313180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.325626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c763-d67c-41e9-9f8b-0f5544929a19 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.325916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c763-d67c-41e9-9f8b-0f5544929a19 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.326202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c763-d67c-41e9-9f8b-0f5544929a19 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.327514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:13:44.329842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:44.331008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:44.332814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.333113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.333391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.372742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG passlib.handlers.bcrypt [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80422) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 20:13:44.373159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG passlib.handlers.bcrypt [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80422) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 20:13:44.409386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:44.418913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:44.420513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:44.432576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:44.455330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:44.518506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:13:44.533413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bed8a-8c15-4a70-995a-ca598b9cc0d9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:44.541240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:44.569855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:44.570583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.570858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.571133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.583033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:44.594866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:44.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:13:44.596889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:13:44.601765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:44.639113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4567ca-3fa7-4a0a-9ef9-41a429a85731 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:44.641515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:44.675861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:44.676781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.677060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.677692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.682094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:44.700071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec99c5-eefd-4899-99f2-53ef6051da9e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:44.734347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:44.735006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.735292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.735572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.736328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:44.736671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:44.738073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:44.743464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:44.744990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:44.749696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:13:44.755938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:44.841892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:13:44.847492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:44.850146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:44.854165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6ede5-dc42-4e8b-96f0-e76b88c0ad60 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:44.887212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:44.888078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.888358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.888648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.889862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:44.891316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:44.892974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:13:44 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:13:44.898867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:44.913151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:44.946562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98330efa-7fbe-4c6a-b8c6-4e1ca1837ce5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:44.978382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:44.979169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:44.979453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:44.979730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:44.995816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc1a8f-64dd-4592-9e50-bc1ac006bbec None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:44.998377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:44.999838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:13:45.020925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:45.021770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:45.022565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:13:45.022565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:13:45.022565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:13:45.022565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:13:45.022565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:13:45.027694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:45.029001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:45.029786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:45.030067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:45.030342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:45.031544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:45.032996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:45.034580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:13:45.040551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:45.083496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:45.118803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:45.126548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8783c-a38b-477e-a939-6ac5f78db551 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:45.137503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d979c-6fae-4932-83e7-f8274b05ea95 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:45.159497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:45.160158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:45.160438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:45.160745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:45.161612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:45.161939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:45.163325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53713b3-e9d2-460a-8509-e21b804e0553 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:45.170239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:45.170886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:45.171173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:45.171451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:45.172295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.domain.id=default, user.id=d83b7d0e898a4c67b76bf60bd5d5825e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:45.172607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:45.174072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece5a75-8689-41d6-9828-8f8408e6159e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:45.180902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:13:45.181483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Jun 16 20:13:45 2022] GET /identity/v3/role_assignments?user.id=d83b7d0e898a4c67b76bf60bd5d5825e&scope.domain.id=default&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:13:47.419530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e117d0-3262-4587-bd7f-60b906325860 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:47.420598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e117d0-3262-4587-bd7f-60b906325860 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:47.421159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e117d0-3262-4587-bd7f-60b906325860 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:47.422747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:47.428833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:47.429642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:47.430132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:47.457611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:47.459281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:47.545894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:13:47.586698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e117d0-3262-4587-bd7f-60b906325860 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:47.721886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e117d0-3262-4587-bd7f-60b906325860 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:47.748379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:47.769512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:47.770341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:47.770719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:47.771006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:47.788678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:47.804682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:47.805591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:13:47.806334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 12/24] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:47.811936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:47.946459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:47.973064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6850ca-38fe-4bef-b004-ddf4026f816d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:48.023649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:48.024702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.025222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.025700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.026668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:48.027175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:48.028811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:48.038172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 13/25] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:48.043780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:48.204411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c49008-fe24-4fbf-a367-56030e0ad80a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:48.253689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79033-e894-40cf-b2f8-9ab821f43bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:48.254493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79033-e894-40cf-b2f8-9ab821f43bab None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.254779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79033-e894-40cf-b2f8-9ab821f43bab None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.255633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79033-e894-40cf-b2f8-9ab821f43bab None admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.257262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c79033-e894-40cf-b2f8-9ab821f43bab None admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:48.258728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c79033-e894-40cf-b2f8-9ab821f43bab None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:48.260369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 13/26] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:13:48 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:48.266069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:48.337494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb8b9-4bdc-44c4-98e2-d9936ded284b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.338037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb8b9-4bdc-44c4-98e2-d9936ded284b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.338443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741eb8b9-4bdc-44c4-98e2-d9936ded284b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.339986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 14/27] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:13:48.351504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc63a9-790b-469e-b964-6477b19abbd0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.352115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc63a9-790b-469e-b964-6477b19abbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.352584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc63a9-790b-469e-b964-6477b19abbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.402296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-98dc63a9-790b-469e-b964-6477b19abbd0 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:48.403963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-98dc63a9-790b-469e-b964-6477b19abbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:48.490476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ec74-79af-4e04-ac9e-d85512e21a6f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:48.501007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:48.542757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:48.543035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee579-de58-48f7-bbd8-c99edfa65ede None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.543305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee579-de58-48f7-bbd8-c99edfa65ede None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.543587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee579-de58-48f7-bbd8-c99edfa65ede None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.547391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 16/29] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:48.553932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.557850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.558513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.564273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d587f-3742-47fe-837f-e5c4e77fe3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:48.565372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d587f-3742-47fe-837f-e5c4e77fe3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.566407 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d587f-3742-47fe-837f-e5c4e77fe3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.567996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d587f-3742-47fe-837f-e5c4e77fe3b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.568860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d587f-3742-47fe-837f-e5c4e77fe3b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:48.570499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d587f-3742-47fe-837f-e5c4e77fe3b0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:48.572330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 14/30] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:48.573890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673274cc-217e-4c16-a99c-5686cc606396 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.574381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673274cc-217e-4c16-a99c-5686cc606396 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.574872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673274cc-217e-4c16-a99c-5686cc606396 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.576594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 15/31] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:48.577619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673274cc-217e-4c16-a99c-5686cc606396 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:48.584169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:48.585317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:48.586651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:48.657411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 17/32] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:48.658538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:48.691448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673274cc-217e-4c16-a99c-5686cc606396 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:48.728874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:48.729919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.730411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.730898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.731859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:48.733473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:48.783662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112308a-5c8a-46c1-9d92-698b96e05038 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:48.787511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:48.819475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e48e-f965-4756-8953-bd7fd6b6c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:48.820275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e48e-f965-4756-8953-bd7fd6b6c152 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:48.820723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e48e-f965-4756-8953-bd7fd6b6c152 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:48.821012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e48e-f965-4756-8953-bd7fd6b6c152 None admin] PATH_INFO: `/v3/domains/default/users/d83b7d0e898a4c67b76bf60bd5d5825e/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:48.823038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e48e-f965-4756-8953-bd7fd6b6c152 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d83b7d0e898a4c67b76bf60bd5d5825e, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:48.824490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e48e-f965-4756-8953-bd7fd6b6c152 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:49.043350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 18/33] 10.222.0.65 () {58 vars in 1361 bytes} [Thu Jun 16 20:13:48 2022] PUT /identity/v3/domains/default/users/d83b7d0e898a4c67b76bf60bd5d5825e/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:13:49.045118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5ba9-1acc-4647-98d6-172927905547 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.045418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5ba9-1acc-4647-98d6-172927905547 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.045705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f5ba9-1acc-4647-98d6-172927905547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.060022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 16/34] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jun 16 20:13:48 2022] POST /identity/v3/roles => generated 219 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:13:49.061479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:49.078184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ca3f5ba9-1acc-4647-98d6-172927905547 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:49.080055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ca3f5ba9-1acc-4647-98d6-172927905547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:49.146177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:49.199114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d8465-302b-4f21-bc78-9d481e7f4779 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:49.245647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04140ba-86d0-49f5-b590-358855421a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:49.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04140ba-86d0-49f5-b590-358855421a36 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.247205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04140ba-86d0-49f5-b590-358855421a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.247678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04140ba-86d0-49f5-b590-358855421a36 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.248724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04140ba-86d0-49f5-b590-358855421a36 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:49.250735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04140ba-86d0-49f5-b590-358855421a36 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:49.301194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 19/35] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:49.302931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66773aa-7001-404f-b7fa-0a2cb397725f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.303229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66773aa-7001-404f-b7fa-0a2cb397725f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.303515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66773aa-7001-404f-b7fa-0a2cb397725f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.307784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 20/36] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:49.312052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020e56b-8ef7-495b-8796-82bdfacd4fcd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.312052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020e56b-8ef7-495b-8796-82bdfacd4fcd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.312052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020e56b-8ef7-495b-8796-82bdfacd4fcd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.312052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 21/37] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:49.314056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.314642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.315200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.323041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 17/38] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jun 16 20:13:49 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:13:49.326488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3550-69be-4b97-ada2-540503444b86 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.326785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3550-69be-4b97-ada2-540503444b86 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.327067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3550-69be-4b97-ada2-540503444b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.342703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:49.344767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:49.351452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-778e3550-69be-4b97-ada2-540503444b86 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:49.354583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-778e3550-69be-4b97-ada2-540503444b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:49.444436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 22/39] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:49.444436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:49.449334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 18/40] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:49.469476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3550-69be-4b97-ada2-540503444b86 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:49.471452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:49.575448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:49.607842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d13762-2775-4fdb-9aa0-30c0701f22a2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:49.649533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3550-69be-4b97-ada2-540503444b86 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:49.657959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:49.658779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.659067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.659351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.673550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:49.675857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:49.686775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:49.687912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.688438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.688945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.690421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:49.692280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:49.694547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 19/41] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:13:49.695560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:13:49.696915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:49.697702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:49.698531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:13:49.698531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:13:49.698531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:13:49.698531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:13:49.698531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 23/42] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:49.704538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:49.788880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:49.812873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28abf9f-32e6-4213-a3ef-f1fe63e58b38 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:49.819196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba565ba-086a-463c-b1bd-259883ea6aca None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:49.842728 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:49.851810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:49.852698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.856011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.856011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.856011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:49.856224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:49.856224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:49.856224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:49.856224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:49.856488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:49.857918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:49.859421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:49.953953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 20/43] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jun 16 20:13:49 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:13:49.954795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:49.984876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 24/44] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:13:49 2022] POST /identity/v3/projects => generated 312 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:13:50.086849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab0229-a953-4997-923f-4b1eede6456b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:50.125093 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:50.125702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:50.125991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:50.126273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:50.127054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:50.127371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:50.128908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151e06b-7591-44d3-a976-8d4510276b6b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:50.150522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 21/45] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:50.157886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:50.274108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb1672-eb1a-416a-a292-5f5f6c6904c4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:50.300834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:50.309205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457201c7-55ea-4b2a-98ee-6d0f9adff7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:50.309926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457201c7-55ea-4b2a-98ee-6d0f9adff7d0 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:50.310217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457201c7-55ea-4b2a-98ee-6d0f9adff7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:50.310550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457201c7-55ea-4b2a-98ee-6d0f9adff7d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:50.311279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457201c7-55ea-4b2a-98ee-6d0f9adff7d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:50.312783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457201c7-55ea-4b2a-98ee-6d0f9adff7d0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:50.400539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 25/46] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:13:50 2022] POST /identity/v3/projects => generated 301 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:13:51.305779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9de7-acb1-4a9b-a8c8-56631af14bda None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:51.306298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9de7-acb1-4a9b-a8c8-56631af14bda None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:51.306401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e9de7-acb1-4a9b-a8c8-56631af14bda None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:51.307716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 22/47] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:51.312912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:51.313306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:51.313491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:51.330297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:51.331484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:51.397384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 26/48] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:51.420079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9de7-acb1-4a9b-a8c8-56631af14bda None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:51.465091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:51.520118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e9de7-acb1-4a9b-a8c8-56631af14bda None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:51.553733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:51.554535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:51.554828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:51.555108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:51.565278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:51.573285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:51.574117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:13:51.575032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 23/49] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:51.580217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:51.680823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de8c6f-98b1-4c43-b51d-3d50a7098286 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:51.691109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:51.713723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:51.714395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:51.714687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:51.714970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:51.715738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:51.716052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:51.717522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:51.729926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 27/50] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:51.735244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:51.833336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf8705d-a1eb-4a70-8801-f8adb53f6070 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:51.834748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:51.866499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:51.867363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:51.867647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:51.867922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:51.869149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:51.870602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:51.872230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 24/51] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:13:51 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:51.877585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:51.976463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91977d18-9409-4674-8e21-a9e70a7f7d7b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:52.008363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec6a25-c820-4de8-bd4d-b3383381a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:52.009176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6a25-c820-4de8-bd4d-b3383381a481 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:52.009460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6a25-c820-4de8-bd4d-b3383381a481 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:52.009735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec6a25-c820-4de8-bd4d-b3383381a481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:52.010904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec6a25-c820-4de8-bd4d-b3383381a481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:52.012353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec6a25-c820-4de8-bd4d-b3383381a481 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:52.014006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 28/52] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:52.019824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:52.119220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f5a5b-ed72-4b4a-af25-ca148c32898c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:52.154330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:52.154982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:52.155268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:52.155545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:52.156386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.domain.id=default, user.id=d83b7d0e898a4c67b76bf60bd5d5825e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:52.156734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:52.158189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34e7c-7d4a-4acc-93be-50eeb4433807 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:52.166025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 25/53] 10.222.0.65 () {56 vars in 1322 bytes} [Thu Jun 16 20:13:52 2022] GET /identity/v3/role_assignments?user.id=d83b7d0e898a4c67b76bf60bd5d5825e&scope.domain.id=default&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:52.166168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d640b71-29a1-4b98-ac10-2739d4382f35 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:52.166168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d640b71-29a1-4b98-ac10-2739d4382f35 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:52.166168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d640b71-29a1-4b98-ac10-2739d4382f35 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:52.167337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 29/54] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:13:52.172784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781810-2682-43cd-8157-737e03471587 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:52.173081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781810-2682-43cd-8157-737e03471587 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:52.173374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee781810-2682-43cd-8157-737e03471587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:52.191124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ee781810-2682-43cd-8157-737e03471587 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:52.192933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ee781810-2682-43cd-8157-737e03471587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:52.223219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:52.265325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 26/55] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:52.289188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d640b71-29a1-4b98-ac10-2739d4382f35 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:52.333426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:52.391592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d640b71-29a1-4b98-ac10-2739d4382f35 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:52.423900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520dafb-0ce1-4508-8db9-49d2c73a7822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:52.424718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520dafb-0ce1-4508-8db9-49d2c73a7822 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:52.425010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520dafb-0ce1-4508-8db9-49d2c73a7822 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:52.425292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520dafb-0ce1-4508-8db9-49d2c73a7822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:52.427265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520dafb-0ce1-4508-8db9-49d2c73a7822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:52.428744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520dafb-0ce1-4508-8db9-49d2c73a7822 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:52.430377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 30/56] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:52.436035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781810-2682-43cd-8157-737e03471587 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:52.531869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee781810-2682-43cd-8157-737e03471587 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:52.565546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4f76e6-bc52-47a6-9079-62a3d2a3093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:52.566207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f76e6-bc52-47a6-9079-62a3d2a3093d None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:52.566496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f76e6-bc52-47a6-9079-62a3d2a3093d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:52.566776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4f76e6-bc52-47a6-9079-62a3d2a3093d None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:52.568057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f76e6-bc52-47a6-9079-62a3d2a3093d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:52.569545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4f76e6-bc52-47a6-9079-62a3d2a3093d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:52.673459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 27/57] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Jun 16 20:13:52 2022] POST /identity/v3/projects => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:13:54.762368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb335f-ad5f-4af0-9f48-c11c96d0590d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:54.762877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb335f-ad5f-4af0-9f48-c11c96d0590d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:54.762992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb335f-ad5f-4af0-9f48-c11c96d0590d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:54.764318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 31/58] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:54.769388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:54.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:54.770455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:54.788006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:54.789229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:54.799504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:54.853473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 28/59] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:54.877338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb335f-ad5f-4af0-9f48-c11c96d0590d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:54.977225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdb335f-ad5f-4af0-9f48-c11c96d0590d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:54.985869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:55.008857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18876774-4aba-4a3f-b266-cd64ed185111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:55.009641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876774-4aba-4a3f-b266-cd64ed185111 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:55.009929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876774-4aba-4a3f-b266-cd64ed185111 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:55.010210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18876774-4aba-4a3f-b266-cd64ed185111 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:55.011386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876774-4aba-4a3f-b266-cd64ed185111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:55.012853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18876774-4aba-4a3f-b266-cd64ed185111 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:55.015007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 32/60] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:55.020269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:55.114248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdc804-08df-434f-bf33-1c7296e7343a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:55.147095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74939f5d-d4c7-4921-ae1c-f901a4404f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:55.147752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74939f5d-d4c7-4921-ae1c-f901a4404f6e None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:55.148039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74939f5d-d4c7-4921-ae1c-f901a4404f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:55.148319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74939f5d-d4c7-4921-ae1c-f901a4404f6e None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:55.149078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74939f5d-d4c7-4921-ae1c-f901a4404f6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:55.150531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74939f5d-d4c7-4921-ae1c-f901a4404f6e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:55.243553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 29/61] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:13:55 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:13:58.589305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ed8a-5e8b-47c8-b967-2d368543d08a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.590280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ed8a-5e8b-47c8-b967-2d368543d08a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.590767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802ed8a-5e8b-47c8-b967-2d368543d08a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.592788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 33/62] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:58.597855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.598387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.598473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.606317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:58.621615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:58.622822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:58.658785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07812d6-5e82-4480-a3f5-71b5d35d0d3e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.659599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07812d6-5e82-4480-a3f5-71b5d35d0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.660417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07812d6-5e82-4480-a3f5-71b5d35d0d3e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.662546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 34/63] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:13:58.674481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00bfa-240e-4f61-aae8-e57635b85990 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.675097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00bfa-240e-4f61-aae8-e57635b85990 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.675600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f00bfa-240e-4f61-aae8-e57635b85990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.706128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-74f00bfa-240e-4f61-aae8-e57635b85990 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:58.707677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-74f00bfa-240e-4f61-aae8-e57635b85990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:58.736563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 30/64] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:58.760373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:58.811467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 35/65] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:58.813018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfa8e-c536-4c4a-b237-4d13920c1e13 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.813456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfa8e-c536-4c4a-b237-4d13920c1e13 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.813937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbfa8e-c536-4c4a-b237-4d13920c1e13 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.819930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 36/66] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:58.821261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.821694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.822119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.839486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:58.841525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:58.891536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af97475-a7cf-44c4-bbcf-d62369eadf15 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:58.923744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:58.933685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 37/67] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:58.940637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:58.940771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:58.940771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:58.940771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:58.940771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:58.948659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:58.958140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:58.959032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:13:58.959799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:13:58.960367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 31/68] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:13:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:58.970536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.011390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.094432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2289d-fa17-4636-9a50-5cdd9fddc0cf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.098472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52c981-a8b8-4598-92f2-60013498df00 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.129225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.130419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.130713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.130992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.131754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:59.132063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.133524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.134038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3892a-57b4-4f90-9f55-46aea05ce294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.134837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3892a-57b4-4f90-9f55-46aea05ce294 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.135119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3892a-57b4-4f90-9f55-46aea05ce294 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.135398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3892a-57b4-4f90-9f55-46aea05ce294 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.141621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 32/69] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:13:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:59.142409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.149174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3892a-57b4-4f90-9f55-46aea05ce294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-93b3892a-57b4-4f90-9f55-46aea05ce294 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:59.156973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:59.157809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:13:59.158557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 38/70] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:13:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:59.159655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9cfe9-8e70-44a6-8068-1e4a8003323a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.159655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9cfe9-8e70-44a6-8068-1e4a8003323a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.159922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9cfe9-8e70-44a6-8068-1e4a8003323a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.164662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 39/71] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:59.164662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f467-4ec7-47ed-8aee-fa446df8c6e7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.164662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f467-4ec7-47ed-8aee-fa446df8c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.164662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2f467-4ec7-47ed-8aee-fa446df8c6e7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.168895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 40/72] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:13:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:13:59.168895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f467-4ec7-47ed-8aee-fa446df8c6e7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.205239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.249391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc176-6a5d-4d8f-974b-08334a79daa6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.261082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.267612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e2f467-4ec7-47ed-8aee-fa446df8c6e7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.281915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.282719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.283000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.283273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.293847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:59.301495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60026b-bc08-4048-adf4-d5f47ef5347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:59.302693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:59.303704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:13:59.304512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:13:59.305122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60026b-bc08-4048-adf4-d5f47ef5347c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.305122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60026b-bc08-4048-adf4-d5f47ef5347c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.305122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60026b-bc08-4048-adf4-d5f47ef5347c None admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.305293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 33/73] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:59.305293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.306304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60026b-bc08-4048-adf4-d5f47ef5347c None admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.307771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60026b-bc08-4048-adf4-d5f47ef5347c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.310721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 41/74] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:59.310991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a7622-2cae-4d68-87d0-79cd1b83e70e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.311281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a7622-2cae-4d68-87d0-79cd1b83e70e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.311558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a7622-2cae-4d68-87d0-79cd1b83e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.327808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f61a7622-2cae-4d68-87d0-79cd1b83e70e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:59.329023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f61a7622-2cae-4d68-87d0-79cd1b83e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:59.392639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 42/75] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:59.393944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.394237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.394515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.405038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d84e-6297-46a1-aae4-bb2f84c7a1a5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.409746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:13:59.410894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:13:59.419511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.439460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.440121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.440408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.440718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.441474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:59.441787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.443723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.451996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 34/76] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:59.452834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.480540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 43/77] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:13:59.481347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.506765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.557822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de25e6-fedd-4a1d-88de-a6f544a6ee11 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.580734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1d1c7-8ddf-4f0f-a412-ab721fd4a71a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.590535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.591195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.591480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.591773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.592500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:13:59.592835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.594199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.602632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 35/78] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:59.603632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.616161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.616843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.617128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.617405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.641834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.685070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.686852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.699208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3604e-4b20-4759-a4e4-4955c6b11c62 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.711294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.733411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.734199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.734487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.734808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.744922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:13:59.752447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:13:59.753519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:13:59.754305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 36/79] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:13:59.754934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.789224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 44/80] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:13:59.790067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.850108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.853747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b5169-57fb-4c69-85c2-fbc93d3fd309 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.887430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.888291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.888580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.888899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.888990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2a5d9-98c7-4015-8e35-04147554eaff None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:13:59.902982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.904449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.906165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 37/81] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:59.906931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:13:59.914274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:13:59.924724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:13:59.925510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:13:59.925794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:13:59.926840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:13:59.927676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:13:59.929157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:13:59.930778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 45/82] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:13:59.931532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.006140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc0cd-f991-4f62-8b78-ea158789f380 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.030999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b4c52-d886-4551-a619-a9b6c3fcd176 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.039645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.040508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.040828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.041104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.042307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.043806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.045473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 38/83] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:00.046233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.068063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.068764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.069056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.069341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.070097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:00.070221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.070411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.071789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.079691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 46/84] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:00.080526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.135238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.143009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6dbd8-ba06-4bbb-909e-820a57fbf904 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.176140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.177306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.177594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.177871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.178315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b967daf-a0e4-4818-80c6-654477a81de7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.179066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.180514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.182245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 39/85] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:00.187419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.214390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.215032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.215321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.215609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.271771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.279792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.284357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bcf74-c6cc-4b80-9f99-32ec7a1febd5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.284466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.314741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.315399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.315688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.315970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.316723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.318710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.333700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.376403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 47/86] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:00.377426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.417579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 40/87] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:00 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:00.418404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.482358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6339-b326-4cc1-ba16-429df913a945 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.520753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.521418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.521705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.522065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.536572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17e74-be2a-44f8-bc33-abac72b0b228 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.550742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.579640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.580014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.580382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.580571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.582186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.584103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.585790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 41/88] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:00.586645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.604416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.606413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.608760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.705550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066ad4a-faea-449f-847c-cd6e48c3ee44 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.726540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 48/89] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:00.727406 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.748501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.749222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.749513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.750232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.751377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=d83b7d0e898a4c67b76bf60bd5d5825e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:00.751710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.753676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.761161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 42/90] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/role_assignments?user.id=d83b7d0e898a4c67b76bf60bd5d5825e&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:00.761800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.799615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.854487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:00.867794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4a13-0710-448d-82e1-3e31b26489a9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.890559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc652a6-2055-4640-b86e-fdb620f3e43c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:00.941726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.943153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.943434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.943706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:00.945731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:00.947201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:00.949029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 49/91] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:00.949802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:00.956265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:00.956968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:00.957256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:00.957541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:01.044108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:01.045633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:01.110272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40371e8b-124f-4837-bacb-5b061aa02279 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:01.137674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:01.150346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:01.151247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:01.151537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:01.151822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:01.153074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:01.154602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:01.156463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 50/92] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:01.157313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:01.170317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 43/93] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:01.171593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:01.175439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:01.281856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6238e36-3b53-4a62-bbb4-2809290e60be None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:01.302155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0a142-8554-4f82-a5b3-95147801c9cd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:01.343336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:01.344017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:01.344304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:01.344588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:01.345463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=b3c17e280bf349a8875528eb95b4e25a) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:01.345780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:01.347229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:01.359634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 51/94] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:01 2022] GET /identity/v3/role_assignments?user.id=b3c17e280bf349a8875528eb95b4e25a&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:01.360515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:01.363901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:01.365141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:01.365425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:01.365704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:01.366582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] RBAC: Adding query filter params (role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=b3c17e280bf349a8875528eb95b4e25a) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:01.366904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:01.368411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:01.378815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 44/95] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:01 2022] GET /identity/v3/role_assignments?user.id=b3c17e280bf349a8875528eb95b4e25a&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ef55a3c470c94814b91be114d41243c5 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:01.464161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:01.525522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910b301-5fa6-450e-8100-e768dd55d9ed None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:01.592279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93750172-1110-47c7-b993-8f4c0b7954dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:01.593217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93750172-1110-47c7-b993-8f4c0b7954dd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:01.593509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93750172-1110-47c7-b993-8f4c0b7954dd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:01.593796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93750172-1110-47c7-b993-8f4c0b7954dd None admin] PATH_INFO: `/v3/projects/7e3bc11bbb79440a947c4e5da9454695` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:01.596073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93750172-1110-47c7-b993-8f4c0b7954dd None admin] RBAC: Authorizing `identity:get_project(project_id=7e3bc11bbb79440a947c4e5da9454695)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:01.597634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93750172-1110-47c7-b993-8f4c0b7954dd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:01.599501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 52/96] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:01 2022] GET /identity/v3/projects/7e3bc11bbb79440a947c4e5da9454695 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:01.605953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:01.679463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:01.751659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a2951-aa01-4f22-acd6-08892d02841a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:01.792044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:01.792732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:01.793017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:01.793293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:01.794142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=7e3bc11bbb79440a947c4e5da9454695, user.id=b3c17e280bf349a8875528eb95b4e25a) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:01.794453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:01.795896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3e522-513e-444d-9731-ad407aa4dade None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:01.808980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 45/97] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:01 2022] GET /identity/v3/role_assignments?user.id=b3c17e280bf349a8875528eb95b4e25a&scope.project.id=7e3bc11bbb79440a947c4e5da9454695&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:03.128679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a704a-3099-4582-9346-44a55b63b740 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.129227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a704a-3099-4582-9346-44a55b63b740 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.129227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a704a-3099-4582-9346-44a55b63b740 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.131556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 53/98] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:03.137081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380776e0-d07b-4f14-adff-d488a11cff2c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.137920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380776e0-d07b-4f14-adff-d488a11cff2c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.138405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380776e0-d07b-4f14-adff-d488a11cff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.161879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-380776e0-d07b-4f14-adff-d488a11cff2c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:03.163582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-380776e0-d07b-4f14-adff-d488a11cff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:03.252814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 46/99] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:03.294271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a704a-3099-4582-9346-44a55b63b740 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:03.436322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a704a-3099-4582-9346-44a55b63b740 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:03.436797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3492d3-5139-4446-80e8-f9ec9d4a17f2 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.437095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3492d3-5139-4446-80e8-f9ec9d4a17f2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.442552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3492d3-5139-4446-80e8-f9ec9d4a17f2 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.442552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 47/100] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:03.444699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.445018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.445302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.471886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:03.477691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:03.478949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:03.493832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:03.495073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.495587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.496133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.517685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:03.525924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:03.526783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:03.527546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:03.534466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 54/101] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:03.541684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:03.543589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:03.647412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 48/102] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:03.694153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:03.769719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee032b-4774-43d4-9735-eafc20c2ddf0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:03.832241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:03.832978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.833255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.833531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.834286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:03.834597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:03.835975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be6b0e-4535-4b1e-85da-d4d51fe572fa None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:03.850688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 55/103] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:03.851996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6cdfe-a4d2-401e-a60d-fa065009b775 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.852286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6cdfe-a4d2-401e-a60d-fa065009b775 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.852563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6cdfe-a4d2-401e-a60d-fa065009b775 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.853948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 56/104] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:03.860940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.861224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.861504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.886831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2312d63-0e91-4362-9b7f-87a966ff8dd8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:03.901520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:03.902934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:03.954468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:03.955191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:03.959668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:03.959948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:03.978472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:03.987489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:03.988351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:03.989166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:03.992847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 49/105] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:03.998957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:03.999086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.046797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 57/106] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:04.047580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:04.053394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.179401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462741c2-e0a4-4cc0-a77f-fcea97a15dd9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.224388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d3c0f-242f-4fb3-8b9d-3e880ab656b6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.240428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.241339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.241679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.241964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] PATH_INFO: `/v3/users/b0725c61624e4206b508aca19d499f0c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.266935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] RBAC: Authorizing `identity:get_user(user_id=b0725c61624e4206b508aca19d499f0c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.270099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.273185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 50/107] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:03 2022] GET /identity/v3/users/b0725c61624e4206b508aca19d499f0c => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:04.274071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:04.293786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.294466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.294756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.295101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.295865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:04.296228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.297653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.312381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 58/108] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:04.313277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:04.385042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.441421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.465650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33042b-e6d1-4665-b749-0c73e37d3254 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.476327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e215b0-fc36-47ca-accb-761809a7238a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.517424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.518735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.519601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.520122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.548635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.548635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.548635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.548635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.549708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.554974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.555108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 51/109] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:04.555841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:04.604850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.606887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.662570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff12c45-f648-45c8-8b8b-d4ef050fcefc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.665186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.703332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604bde-fcf7-489e-b92e-db717bc4a8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.704481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604bde-fcf7-489e-b92e-db717bc4a8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.704799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604bde-fcf7-489e-b92e-db717bc4a8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.705084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604bde-fcf7-489e-b92e-db717bc4a8a8 None admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.706721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4604bde-fcf7-489e-b92e-db717bc4a8a8 None admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.711822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4604bde-fcf7-489e-b92e-db717bc4a8a8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.711822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 52/110] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:04 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:04.711822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07025-0662-4d39-9292-825346bc2660 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.711822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07025-0662-4d39-9292-825346bc2660 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.712127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c07025-0662-4d39-9292-825346bc2660 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.713671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 53/111] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:04.717892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07025-0662-4d39-9292-825346bc2660 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:04.723621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 59/112] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:04.724812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:04.750045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.831435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9ecc5-b4ae-4b7b-90cc-fdc2d1a94cbb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.868426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c07025-0662-4d39-9292-825346bc2660 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:04.873962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483ba46-43da-4e41-85de-b99f15782538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.875032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483ba46-43da-4e41-85de-b99f15782538 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.875411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483ba46-43da-4e41-85de-b99f15782538 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.875788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483ba46-43da-4e41-85de-b99f15782538 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.877294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483ba46-43da-4e41-85de-b99f15782538 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.878898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483ba46-43da-4e41-85de-b99f15782538 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.881098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 60/113] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:04 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:04.882527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.882752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.883150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.891199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:04.906395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:04.907995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:04.915548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:04.916213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:04.916498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:04.916820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:04.917610 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:04.919066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:04.978293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 61/114] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:04.979140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.004236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 54/115] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:14:04 2022] POST /identity/v3/projects => generated 302 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:05.005144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.088224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:05.092782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e12ce-aed8-4dbb-ad18-5aad7983ebd1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.116074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652527b9-fbb1-4148-b9c8-a201291d0e37 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.131973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d4e2d-5b5a-4fe7-bdb7-f767a2aa320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.132942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4e2d-5b5a-4fe7-bdb7-f767a2aa320a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.133226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4e2d-5b5a-4fe7-bdb7-f767a2aa320a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.133504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4e2d-5b5a-4fe7-bdb7-f767a2aa320a None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.134924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4e2d-5b5a-4fe7-bdb7-f767a2aa320a None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:05.136481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d4e2d-5b5a-4fe7-bdb7-f767a2aa320a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:05.138614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 62/116] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:04 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:05.139878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bcda3-f16a-4fb7-8804-ac6001931754 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.140260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bcda3-f16a-4fb7-8804-ac6001931754 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.140587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953bcda3-f16a-4fb7-8804-ac6001931754 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.142215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 63/117] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:05.147372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d9395-4965-4d2e-8e0a-6ec24904542a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.147372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d9395-4965-4d2e-8e0a-6ec24904542a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.147372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d9395-4965-4d2e-8e0a-6ec24904542a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.147372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 64/118] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:05.147372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d9395-4965-4d2e-8e0a-6ec24904542a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.150922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:05.165430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8585c8-245f-4179-9b23-071807825437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.166331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8585c8-245f-4179-9b23-071807825437 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.166621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8585c8-245f-4179-9b23-071807825437 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.166905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8585c8-245f-4179-9b23-071807825437 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54/users/d83b7d0e898a4c67b76bf60bd5d5825e/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.169020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8585c8-245f-4179-9b23-071807825437 None admin] RBAC: Authorizing `identity:create_grant(project_id=f97693405a1044c69788e4853614cb54, user_id=d83b7d0e898a4c67b76bf60bd5d5825e, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:05.170553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8585c8-245f-4179-9b23-071807825437 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:05.246474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 55/119] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:05 2022] PUT /identity/v3/projects/f97693405a1044c69788e4853614cb54/users/d83b7d0e898a4c67b76bf60bd5d5825e/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:05.248104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8585c8-245f-4179-9b23-071807825437 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.263475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d9395-4965-4d2e-8e0a-6ec24904542a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.311020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d3e73-fe58-49a5-8c4a-8240419d2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.311713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3e73-fe58-49a5-8c4a-8240419d2b1d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.312000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3e73-fe58-49a5-8c4a-8240419d2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.312322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3e73-fe58-49a5-8c4a-8240419d2b1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.327652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d3e73-fe58-49a5-8c4a-8240419d2b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-9d7d3e73-fe58-49a5-8c4a-8240419d2b1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:05.337806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:05.338747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:05.339516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 65/120] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:05.345678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686955bd-2bcf-46c3-9916-2c0edd868f7d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.345991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686955bd-2bcf-46c3-9916-2c0edd868f7d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.346243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686955bd-2bcf-46c3-9916-2c0edd868f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.365577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-686955bd-2bcf-46c3-9916-2c0edd868f7d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:05.366860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-686955bd-2bcf-46c3-9916-2c0edd868f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:05.398597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8585c8-245f-4179-9b23-071807825437 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.436264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:05.447988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.449031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.449324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.449607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.450460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] RBAC: Adding query filter params (role.id=02a07d0fba054284b839937e5b867451, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=b0725c61624e4206b508aca19d499f0c) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:05.450777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:05.451771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 66/121] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:05.452225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:05.456701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.456701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.456701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.458121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:05.463571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 56/122] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/role_assignments?user.id=b0725c61624e4206b508aca19d499f0c&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=02a07d0fba054284b839937e5b867451 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:05.466333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.486179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:05.487436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:05.567576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 67/123] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:05.568327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.612630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4a470-396f-4b4e-be3f-c75f347c1e73 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.668036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.669006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.669301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.669586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.670372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:05.670689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:05.673664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:05.692307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 57/124] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:05.693908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.701233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e6938-c89e-4988-9f9f-aaf56d20b51c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.746915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:05.768254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.773918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.774213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.774546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.788068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:05.796381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:05.797252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:05.797998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 68/125] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:05.798619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:05.813471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:05.906126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461cba4-a8c5-43fc-a7ef-b05af8030f4f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.949912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23f88c-ea36-4334-acfb-df9f28b16b1d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:05.981357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.982178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.982468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.982748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.991209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:05.992088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:05.992369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:05.992676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:05.994057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:05.995626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:05.997623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 69/126] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:05.998468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.033260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:06.041568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:06.043853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:06.045772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 58/127] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:06.053195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.058764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:06.115850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede9d15-7117-4441-9bef-e3c11e548c29 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:06.174230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:06.175178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:06.175607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:06.176323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:06.177263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:06.177729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:06.179254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:06.202103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 70/128] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:06.202969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.212478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f13a76-a5d6-46fa-b103-9e900a192469 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:06.237011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:06.252448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:06.254110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:06.254540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:06.254962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:06.256307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:06.259626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:06.260046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 59/129] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:06 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:06.260976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.410929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187df91-847c-448f-a0aa-203f4478a1df None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:06.434969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59389a43-9304-405e-899d-1e3d7ac68113 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:06.435533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:06.477484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:06.478386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:06.478994 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:06.480525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:06.481464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:06.482572 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:06.484110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:06.495841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 71/130] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:06.497657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.502873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:06.503742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:06.504062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:06.504327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:06.505651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:06.507094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:06.518334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 60/131] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:06 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:06.519135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.648982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:06.669598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec1f0d-0ed0-4dca-82fa-335c5a7a5c7b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:06.709536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:06.710512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:06.710795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:06.711072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54/users/b3c17e280bf349a8875528eb95b4e25a/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:06.721197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] RBAC: Authorizing `identity:create_grant(project_id=f97693405a1044c69788e4853614cb54, user_id=b3c17e280bf349a8875528eb95b4e25a, role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:06.722694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:06.740152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a0be7-971f-4f70-aa8f-29276732ed34 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:06.776962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:06.777839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:06.778123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:06.778400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:06.779766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:06.781264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:06.782898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 61/132] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:06 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:06.783662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.835130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 72/133] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:06 2022] PUT /identity/v3/projects/f97693405a1044c69788e4853614cb54/users/b3c17e280bf349a8875528eb95b4e25a/roles/ef55a3c470c94814b91be114d41243c5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:06.835981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:06.909568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:06.963695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f9307-3cf9-4552-961c-6cec98bc4f3c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:07.000970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:07.009586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:07.010471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.010754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.011046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.012699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:07.019174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:07.019174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 62/134] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:06 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:07.022345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:07.057495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dde4ca-4366-4b89-bf73-54fec568898d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:07.134387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:07.135720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.136299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.137082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] PATH_INFO: `/v3/projects/7e3bc11bbb79440a947c4e5da9454695` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.141415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] RBAC: Authorizing `identity:get_project(project_id=7e3bc11bbb79440a947c4e5da9454695)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:07.142392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9c189-bd23-4e65-95a4-2348e78b430d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:07.143428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:07.145754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 73/135] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:06 2022] GET /identity/v3/projects/7e3bc11bbb79440a947c4e5da9454695 => generated 312 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:07.151411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:07.180523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682a235-e18a-456e-bc44-8b77501039d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:07.181620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682a235-e18a-456e-bc44-8b77501039d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.182017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682a235-e18a-456e-bc44-8b77501039d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.182391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682a235-e18a-456e-bc44-8b77501039d4 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54/users/b3c17e280bf349a8875528eb95b4e25a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.184478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682a235-e18a-456e-bc44-8b77501039d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f97693405a1044c69788e4853614cb54, user_id=b3c17e280bf349a8875528eb95b4e25a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:07.186046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682a235-e18a-456e-bc44-8b77501039d4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:07.266305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 63/136] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:07 2022] PUT /identity/v3/projects/f97693405a1044c69788e4853614cb54/users/b3c17e280bf349a8875528eb95b4e25a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:07.289386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7face13a-fa9d-483e-8cef-fa8c77c22d0f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:07.293017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:07.332065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb611c-54ba-4ae7-9356-dfb9b68d1916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:07.333589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb611c-54ba-4ae7-9356-dfb9b68d1916 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.333870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb611c-54ba-4ae7-9356-dfb9b68d1916 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.334148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb611c-54ba-4ae7-9356-dfb9b68d1916 None admin] PATH_INFO: `/v3/projects/7e3bc11bbb79440a947c4e5da9454695/users/b3c17e280bf349a8875528eb95b4e25a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.339219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb611c-54ba-4ae7-9356-dfb9b68d1916 None admin] RBAC: Authorizing `identity:create_grant(project_id=7e3bc11bbb79440a947c4e5da9454695, user_id=b3c17e280bf349a8875528eb95b4e25a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:07.340787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb611c-54ba-4ae7-9356-dfb9b68d1916 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:07.478617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 74/137] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:07 2022] PUT /identity/v3/projects/7e3bc11bbb79440a947c4e5da9454695/users/b3c17e280bf349a8875528eb95b4e25a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:14:07.546313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5221-5388-4938-ad54-45b7ce449ae5 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.546313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5221-5388-4938-ad54-45b7ce449ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.546313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d5221-5388-4938-ad54-45b7ce449ae5 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.546313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 64/138] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:07.553278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.553935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.554426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.573581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:07.575170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:07.656556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 75/139] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:07.683335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5221-5388-4938-ad54-45b7ce449ae5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:07.755868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:07.805809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d5221-5388-4938-ad54-45b7ce449ae5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:07.844306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f4094-d01b-48ef-b940-75a96d8cac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:07.845075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4094-d01b-48ef-b940-75a96d8cac26 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.845762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4094-d01b-48ef-b940-75a96d8cac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.846043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f4094-d01b-48ef-b940-75a96d8cac26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:07.847294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4094-d01b-48ef-b940-75a96d8cac26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:07.849814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5f4094-d01b-48ef-b940-75a96d8cac26 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:07.851695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 65/140] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:07.857409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:07.954235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:07.963678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911354c0-fa2e-4685-b9c4-21c443230acf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:07.998165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20b10b-1f81-440a-9f00-a482e8fad6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:07.998949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b10b-1f81-440a-9f00-a482e8fad6ce None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:07.999233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b10b-1f81-440a-9f00-a482e8fad6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:07.999561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b10b-1f81-440a-9f00-a482e8fad6ce None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.000294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20b10b-1f81-440a-9f00-a482e8fad6ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:08.001791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20b10b-1f81-440a-9f00-a482e8fad6ce None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:08.118367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 76/141] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:07 2022] POST /identity/v3/users => generated 283 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:08.242535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69b712-c531-4ebe-bf51-b85a6ee222ae None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.242889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69b712-c531-4ebe-bf51-b85a6ee222ae None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.243106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69b712-c531-4ebe-bf51-b85a6ee222ae None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.244484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 66/142] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:08.249947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.250242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.250527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.265944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e9d8-0479-4894-a086-2edadf1aad77 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.266238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e9d8-0479-4894-a086-2edadf1aad77 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.266506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178e9d8-0479-4894-a086-2edadf1aad77 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.268180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 67/143] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:08.273507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:08.274816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:08.287163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.287503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.287725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.315571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:08.317350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:08.395832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 77/144] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:08.419756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:08.449311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 68/145] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:08.494025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:08.518641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:08.526344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131fc7-8e58-4ee4-83d0-6e5b84e0dd25 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:08.574961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:08.576048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.576583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.577105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.588840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:08.597783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:08.598851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:08.599823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:08.602062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 78/146] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:14:08.616506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:08.630989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:08.702455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6004e3-6b66-441c-9bb9-71646d766d63 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:08.775987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:08.777069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.777491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.777918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.791484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3382-172a-4440-bf14-8e9e1bc90002 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:08.799064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:08.812049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:08.813167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:08.814076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:08.815985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 69/147] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:14:08.821761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:08.842895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:08.843728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:08.844014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:08.844290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:08.845092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:08.847085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:08.847085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:08.861577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:08.870806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 79/148] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:08.887629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:09.010110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d17f2-2563-4570-9cee-0b7d3939cd29 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.028448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395e5bd-4d5b-4a88-b779-f7a21a8a163d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.046700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:09.057716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.065322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.065322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.065322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] PATH_INFO: `/v3/users/b0725c61624e4206b508aca19d499f0c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.065322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] RBAC: Authorizing `identity:get_user(user_id=b0725c61624e4206b508aca19d499f0c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.065322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.065322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 80/149] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:08 2022] GET /identity/v3/users/b0725c61624e4206b508aca19d499f0c => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:09.071484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:09.098577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.101111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.101841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.102945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.103860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:09.105765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.108648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.129096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 70/150] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:09.131033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:09.213965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:09.263143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6439f1-079c-4371-bb26-39248445581a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.291686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef69a6-1855-4917-9244-9aa1ac1ebcf2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.307361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.308240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.308523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.308833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.311776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.311776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.313262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 81/151] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:09 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:09.319506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:09.356191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.357489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.357990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.358506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] PATH_INFO: `/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.360882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] RBAC: Authorizing `identity:get_user(user_id=d83b7d0e898a4c67b76bf60bd5d5825e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.362621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.365706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 71/152] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:09 2022] GET /identity/v3/users/d83b7d0e898a4c67b76bf60bd5d5825e => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:09.373052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:09.468821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c6987a-8884-4e2c-b0e5-fa82a42dd439 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.481046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:09.524835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.525667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.525950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.526229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54/users/b0725c61624e4206b508aca19d499f0c/roles/02a07d0fba054284b839937e5b867451` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.531666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] RBAC: Authorizing `identity:create_grant(project_id=f97693405a1044c69788e4853614cb54, user_id=b0725c61624e4206b508aca19d499f0c, role_id=02a07d0fba054284b839937e5b867451)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.533255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.536641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:09.559984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d6c11-f4a3-4c9c-beb5-9c55118355b6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.595807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.596512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.596862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.597144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.612875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 82/153] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:09 2022] PUT /identity/v3/projects/f97693405a1044c69788e4853614cb54/users/b0725c61624e4206b508aca19d499f0c/roles/02a07d0fba054284b839937e5b867451 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:14:09.675293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.678536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.720994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:09.781552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 72/154] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:14:09.787929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:09.929603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a991f6-d2d2-4550-af5e-ddd65ee0d21d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:09.966666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6253f6-ae4c-4ff8-9b3f-ad72a968a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:09.967589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6253f6-ae4c-4ff8-9b3f-ad72a968a856 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:09.967885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6253f6-ae4c-4ff8-9b3f-ad72a968a856 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:09.968163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6253f6-ae4c-4ff8-9b3f-ad72a968a856 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:09.970697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6253f6-ae4c-4ff8-9b3f-ad72a968a856 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:09.972177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6253f6-ae4c-4ff8-9b3f-ad72a968a856 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:09.974942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 83/155] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:09 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:09.980528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:10.048398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3d77d-7f30-4945-9bb9-6b26e47cc7be None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:10.048724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3d77d-7f30-4945-9bb9-6b26e47cc7be None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:10.048909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3d77d-7f30-4945-9bb9-6b26e47cc7be None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:10.050297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 84/156] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:10.062468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:10.062789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:10.063033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:10.101381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:10.102604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:10.140092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a65b4-cf0f-4690-ada0-8986c9b5ae70 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:10.200767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:10.201432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:10.201715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:10.201992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:10.202950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=d83b7d0e898a4c67b76bf60bd5d5825e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:10.203273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:10.204767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:10.213757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 73/157] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:09 2022] GET /identity/v3/role_assignments?user.id=d83b7d0e898a4c67b76bf60bd5d5825e&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:10.241368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:10.254833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 85/158] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:10.304986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:10.309210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:10.438968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586da370-4786-454a-938d-6df914eb2e4a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:10.474171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:10.474986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:10.475268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:10.475539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:10.486367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:10.495344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:10.496259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:10.497129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 74/159] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:10.505135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:10.652708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f70ce3-d743-4db7-95cb-ccbff236b508 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:10.697329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:10.698009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:10.698294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:10.698570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:10.699326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:10.699632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:10.701037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:10.712459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 86/160] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:10.717989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:10.806009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:10.853782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2e56-9e1f-4ccb-aeef-c51af3582135 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:10.898238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:10.899128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:10.899411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:10.899686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:10.900955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:10.902403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:10.904406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 75/161] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:10 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:10.909824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:10.994880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:11.053559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6f26c-af8d-4579-a0b8-1a63126016eb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:11.100821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12ff27-5da8-433b-a4f8-a87b098deb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:11.101468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ff27-5da8-433b-a4f8-a87b098deb59 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.101752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ff27-5da8-433b-a4f8-a87b098deb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.102029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12ff27-5da8-433b-a4f8-a87b098deb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.189628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12ff27-5da8-433b-a4f8-a87b098deb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:11.191656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12ff27-5da8-433b-a4f8-a87b098deb59 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:11.256193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:11.310160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 87/162] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:11.316044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:11.344204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9f24-e2b6-4843-bab4-347fd854d7b4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.344873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9f24-e2b6-4843-bab4-347fd854d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.345379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9f24-e2b6-4843-bab4-347fd854d7b4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.346979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 88/163] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:11.352812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38732e-989c-486c-9678-61160dd18025 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.353352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38732e-989c-486c-9678-61160dd18025 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.353833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38732e-989c-486c-9678-61160dd18025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.389676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3e38732e-989c-486c-9678-61160dd18025 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:11.394721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3e38732e-989c-486c-9678-61160dd18025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:11.472951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50761543-e7ec-4c03-a6d3-b826f3fe1de8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:11.512487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:11.522385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:11.523267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.526573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.526573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.526573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:11.526573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:11.528674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 76/164] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:11 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:11.534510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:11.554383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 89/165] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:11.599863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38732e-989c-486c-9678-61160dd18025 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:11.676532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36dc8f-3201-4420-aad8-b62c8c915d65 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:11.737074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:11.751840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38732e-989c-486c-9678-61160dd18025 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:11.769980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:11.770658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.770942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.771219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.772072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] RBAC: Adding query filter params (role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=b3c17e280bf349a8875528eb95b4e25a) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:11.772393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:11.773862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89983e85-a518-4bf8-a347-d211833f17bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:11.788713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:11.789300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 77/166] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:11 2022] GET /identity/v3/role_assignments?user.id=b3c17e280bf349a8875528eb95b4e25a&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ef55a3c470c94814b91be114d41243c5 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:11.789599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.789892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.790173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.790366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f856-4ef5-4318-892a-39a7d10ae6c1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.790661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f856-4ef5-4318-892a-39a7d10ae6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.790929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4f856-4ef5-4318-892a-39a7d10ae6c1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.792175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 78/167] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:11.803421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:11.804816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:11.805474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:11.814809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:11.830084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:11.831218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:11.832643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:11.836175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 90/168] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:14:11.843684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:11.845232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:11.849526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:11.984926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:12.009006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 79/169] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:12.046652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718965cf-980f-4670-bc28-892bb735a85c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:12.093915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:12.094607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.094890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.095165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.095998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:12.096313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:12.098378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:12.107584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 91/170] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:12.112779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.124490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.145018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:12.241067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd303a5-1155-4b53-9fdb-fb897e06574e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:12.277532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:12.278380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.278665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.278941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.280160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:12.281636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:12.283277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 92/171] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:12.289347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.346343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299f593-4b04-4f52-a8da-f51e847105ca None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:12.367586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:12.390916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05bb3d-d808-42ca-83e1-0adc8061d943 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:12.417342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:12.418167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.418454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.418734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.427878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:12.428578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.428911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.429187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.432749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:12.450900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:12.451825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:12.452601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 80/172] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:12.477684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.510027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:12.511499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:12.584958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:12.592533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:12.617655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 93/173] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:12.623379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.661273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e4738d-fc5f-40bc-8c56-527acc93e991 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:12.721894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:12.723148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.723427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.723700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.724464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:12.724795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:12.726169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d7fd-f756-4fc3-a3c2-d5b0d64b9289 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:12.731149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0234855-eb6a-4b30-94f9-bb5174931b9a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:12.746973 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 81/174] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:12.748147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b34de-8e6a-40e6-9b23-15c03f4a9237 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.748486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b34de-8e6a-40e6-9b23-15c03f4a9237 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.748791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b34de-8e6a-40e6-9b23-15c03f4a9237 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.750279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 82/175] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:12.757787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b34de-8e6a-40e6-9b23-15c03f4a9237 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.766748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586dfd4c-8a36-47a8-aa31-8ae834ddeeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:12.767619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dfd4c-8a36-47a8-aa31-8ae834ddeeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.767904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dfd4c-8a36-47a8-aa31-8ae834ddeeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.768178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586dfd4c-8a36-47a8-aa31-8ae834ddeeb7 None admin] PATH_INFO: `/v3/projects/7e3bc11bbb79440a947c4e5da9454695` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.769954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dfd4c-8a36-47a8-aa31-8ae834ddeeb7 None admin] RBAC: Authorizing `identity:get_project(project_id=7e3bc11bbb79440a947c4e5da9454695)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:12.771385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586dfd4c-8a36-47a8-aa31-8ae834ddeeb7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:12.776715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 94/176] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/projects/7e3bc11bbb79440a947c4e5da9454695 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:12.778001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:12.778291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:12.778574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:12.797663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:12.798819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:12.841455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:12.868977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 95/177] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:12.869726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:12.973827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ce071-8331-4fb0-8141-9ee1e5b70e46 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.015976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.016866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.017159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.017435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.018274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=7e3bc11bbb79440a947c4e5da9454695, user.id=b3c17e280bf349a8875528eb95b4e25a) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:13.018587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.021422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.037813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b34de-8e6a-40e6-9b23-15c03f4a9237 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.039453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 96/178] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/role_assignments?user.id=b3c17e280bf349a8875528eb95b4e25a&scope.project.id=7e3bc11bbb79440a947c4e5da9454695&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:13.041336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.076729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.115649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.116627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.117099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.117383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] PATH_INFO: `/v3/users/b3c17e280bf349a8875528eb95b4e25a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.122303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] RBAC: Authorizing `identity:get_user(user_id=b3c17e280bf349a8875528eb95b4e25a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.123868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.126313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 83/179] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:12 2022] GET /identity/v3/users/b3c17e280bf349a8875528eb95b4e25a => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:13.132712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.162436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.282550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d0f84-0b4d-4ce6-9646-67cd76cc5bcc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.294814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8a299-2181-46a1-98d6-93ba8ad42f89 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.322017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b8d05-34a6-463c-9244-b7cfbc9ec65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.322696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8d05-34a6-463c-9244-b7cfbc9ec65a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.322961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8d05-34a6-463c-9244-b7cfbc9ec65a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.323249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b8d05-34a6-463c-9244-b7cfbc9ec65a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.347790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9db6e-56a4-4cb1-9197-38fcf34516ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.348683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9db6e-56a4-4cb1-9197-38fcf34516ea None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.349868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9db6e-56a4-4cb1-9197-38fcf34516ea None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.350154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9db6e-56a4-4cb1-9197-38fcf34516ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.369576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9db6e-56a4-4cb1-9197-38fcf34516ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-98d9db6e-56a4-4cb1-9197-38fcf34516ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:13.380171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:13.381100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:13.381884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:13.384031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 97/180] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:13.384031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0b4cc-7c6e-403c-a453-677ac43bc655 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.384188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0b4cc-7c6e-403c-a453-677ac43bc655 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.384402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0b4cc-7c6e-403c-a453-677ac43bc655 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.388802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 98/181] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:13.399367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0b4cc-7c6e-403c-a453-677ac43bc655 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.402649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.427312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8d05-34a6-463c-9244-b7cfbc9ec65a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.429814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b8d05-34a6-463c-9244-b7cfbc9ec65a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.500418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.506189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0b4cc-7c6e-403c-a453-677ac43bc655 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.543502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 84/182] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:14:13.544834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.545126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.545402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.548441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.549145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.549537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.549818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.552971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:13.553171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.554523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142668dc-79a6-46c7-bf94-a90e8b8d41ac None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.563135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 99/183] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:13.568482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:13.569563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6255-40e8-416e-8a7b-53e3b3fc845c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.569856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6255-40e8-416e-8a7b-53e3b3fc845c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.569951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:13.570139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c6255-40e8-416e-8a7b-53e3b3fc845c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.571774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 100/184] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:13.572325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6255-40e8-416e-8a7b-53e3b3fc845c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.647452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 85/185] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:13.649563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.663835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.685836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c6255-40e8-416e-8a7b-53e3b3fc845c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.720126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458c4f1-11f2-447e-afc0-806a809cd2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.721007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458c4f1-11f2-447e-afc0-806a809cd2a2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.721289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458c4f1-11f2-447e-afc0-806a809cd2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.721564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458c4f1-11f2-447e-afc0-806a809cd2a2 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.722776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458c4f1-11f2-447e-afc0-806a809cd2a2 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.724209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458c4f1-11f2-447e-afc0-806a809cd2a2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.726072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 101/186] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:13.727303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.727666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.728064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.745645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:13.746837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:13.747648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcbefa-8530-4508-ad80-0f32cff286e6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.768897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.780190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8a6d2-0b28-40ab-b30c-7393a72c760d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.781699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8a6d2-0b28-40ab-b30c-7393a72c760d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.781699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8a6d2-0b28-40ab-b30c-7393a72c760d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.781699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8a6d2-0b28-40ab-b30c-7393a72c760d None admin] PATH_INFO: `/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.795161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8a6d2-0b28-40ab-b30c-7393a72c760d None admin] RBAC: Authorizing `identity:get_user(user_id=6acc088cc58f4ac6a787a8bafc0a4dbe)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.796597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8a6d2-0b28-40ab-b30c-7393a72c760d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.798448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 86/187] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:13.799447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25eb1b-e607-4c59-b05e-aecbc6ffc730 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.799725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25eb1b-e607-4c59-b05e-aecbc6ffc730 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.799990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe25eb1b-e607-4c59-b05e-aecbc6ffc730 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.802141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 87/188] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:13.802831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25eb1b-e607-4c59-b05e-aecbc6ffc730 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.815942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 102/189] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:13.817585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.873055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:13.903276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe25eb1b-e607-4c59-b05e-aecbc6ffc730 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.915337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5324267-eb57-4275-8a07-4242b1838ded None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:13.935745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.936548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.936860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.937142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.947437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:13.948958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:13.949603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.949886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.950162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.950992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=b3c17e280bf349a8875528eb95b4e25a) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:13.951310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:13.952772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5888c-f89e-4da7-9dab-6810266546a6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:13.955490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:13.957153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 88/190] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:13.963213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:13.963930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 103/191] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/role_assignments?user.id=b3c17e280bf349a8875528eb95b4e25a&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:13.963930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:13.963930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:13.963930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:13.982509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:13.983739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:14.002857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.068458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 104/192] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:14.072877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.094140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ae3f9-60d5-4cbe-9de6-87265819b10f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.130641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.138664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.139391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.139679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.142146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.185831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ceeef-834e-4a05-be78-6306c0c9a0c3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.214712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.216174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.227295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.228082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.228364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.228665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.229857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.231271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.232929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 105/193] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:14.233680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.256676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.315434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 89/194] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:14.315434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.332583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1126-6c37-48f3-b4d7-2186f7cc5a76 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.347162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.367374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.368034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.368313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.368586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.369380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:14.369684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.371127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.380602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 106/195] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:14.381411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.418892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637be91-6015-4b64-858a-5a79199a0ad0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.452494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.453238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.453524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.453800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.461581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.464435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:14.472555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:14.473966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:14.474742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 90/196] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:14.475410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.483853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f67a24-1819-4839-a719-af3c5bd160ec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.517272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.517932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.518216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.518491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.519726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.521226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.565490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.574264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ed32e-2a54-4acc-ba8c-227be7c44df1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.606459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.607311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.607596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.607871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.609097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.610531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.612210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 91/197] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:14.613041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.619661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 107/198] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:14 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:14.620659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.726179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133a5f3-6232-4bba-90e1-3746b4739cea None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.747974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8fc25-295e-4d70-9383-0d387e7fd5bc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.764123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.765047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.765333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.765611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] PATH_INFO: `/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.767159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] RBAC: Authorizing `identity:get_user(user_id=6acc088cc58f4ac6a787a8bafc0a4dbe)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.768664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.772006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 92/199] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:14.773085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.787988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.788692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.788988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.789261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.790849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:14.790849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.793445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.797262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.802432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 108/200] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:14.805658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.811179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:14.899113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18deb6-4d40-4c9c-89b2-b74a464b69d8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.917715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70b1ec-767b-4fc6-a97c-7843de8836a2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:14.938537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.939197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.939474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.939746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:14.941176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=6acc088cc58f4ac6a787a8bafc0a4dbe) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:14.941495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:14.942935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:14.948509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 93/201] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/role_assignments?user.id=6acc088cc58f4ac6a787a8bafc0a4dbe&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:14.949323 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:14.953640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:14.953640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:14.953871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:14.954027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:15.038795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:15.041272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:15.042756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:15.091135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:15.104121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a8350-8c5c-4dfd-b1fb-cbaca9c42518 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:15.152153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:15.153077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:15.153362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:15.153641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] PATH_INFO: `/v3/users/b0725c61624e4206b508aca19d499f0c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:15.154876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] RBAC: Authorizing `identity:get_user(user_id=b0725c61624e4206b508aca19d499f0c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:15.156331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:15.158856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 94/202] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/users/b0725c61624e4206b508aca19d499f0c => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:15.165118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:15.178375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 109/203] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:15.183888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:15.308274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:15.313796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f27769-0596-4b02-9f37-3d82e6825134 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:15.334372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a268e64-3c19-4d75-be92-b1f041dfcc8c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:15.381864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:15.384175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:15.385713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:15.386200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:15.388943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:15.389756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:15.391409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:15.396679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:15.396679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:15.396679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:15.398274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 110/204] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:15 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:15.401525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:15.447850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:15.507965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:15.509499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:15.603179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecaba0f-8489-4553-a7b6-7a498d75ac07 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:15.679453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:15.680122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:15.680409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:15.680714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:15.681566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] RBAC: Adding query filter params (role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=6acc088cc58f4ac6a787a8bafc0a4dbe) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:15.681885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:15.683322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:15.699589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 111/205] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:15 2022] GET /identity/v3/role_assignments?user.id=6acc088cc58f4ac6a787a8bafc0a4dbe&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ef55a3c470c94814b91be114d41243c5 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:15.717628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 95/206] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:15.724014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:15.772984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:15.856679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db671ba-2ee5-4476-9d9b-a531628770af None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:15.894976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c452a10-81b1-40b1-b83f-d0caf662845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:15.895849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452a10-81b1-40b1-b83f-d0caf662845c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:15.896133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452a10-81b1-40b1-b83f-d0caf662845c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:15.896410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c452a10-81b1-40b1-b83f-d0caf662845c None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:15.897680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c452a10-81b1-40b1-b83f-d0caf662845c None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:15.899157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c452a10-81b1-40b1-b83f-d0caf662845c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:15.901198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 112/207] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:15 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:15.907103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:15.980994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:16.016249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac539e-88e1-47ba-b3e2-07aa1a5f7a51 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:16.052423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:16.053113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:16.053397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:16.053675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:16.054531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] RBAC: Adding query filter params (role.id=02a07d0fba054284b839937e5b867451, scope.project.id=f97693405a1044c69788e4853614cb54, user.id=b0725c61624e4206b508aca19d499f0c) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:16.054846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:16.056302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec3bb2-d8f4-496d-9171-6db52cc74379 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:16.062516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 96/208] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:15 2022] GET /identity/v3/role_assignments?user.id=b0725c61624e4206b508aca19d499f0c&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=02a07d0fba054284b839937e5b867451 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:17.133539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ac283-91c1-4cb7-8647-ae0a8a37949a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.134068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ac283-91c1-4cb7-8647-ae0a8a37949a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.134386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ac283-91c1-4cb7-8647-ae0a8a37949a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.135889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 113/209] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:17.141326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbadcc-cc85-4dc9-8f78-006b417c2e1c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.141745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbadcc-cc85-4dc9-8f78-006b417c2e1c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.142070 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbadcc-cc85-4dc9-8f78-006b417c2e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.159953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ebfbadcc-cc85-4dc9-8f78-006b417c2e1c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:17.161172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ebfbadcc-cc85-4dc9-8f78-006b417c2e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:17.235972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 97/210] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:17.258734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ac283-91c1-4cb7-8647-ae0a8a37949a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.279811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667651-dd06-494e-9d0b-0c372df8c878 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.280107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667651-dd06-494e-9d0b-0c372df8c878 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.280397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667651-dd06-494e-9d0b-0c372df8c878 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.282197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 98/211] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:17.288522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f1c18-bbaf-47b2-b82f-5b1506b85f58 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.288879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f1c18-bbaf-47b2-b82f-5b1506b85f58 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.289129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f1c18-bbaf-47b2-b82f-5b1506b85f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.313060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-728f1c18-bbaf-47b2-b82f-5b1506b85f58 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:17.315025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-728f1c18-bbaf-47b2-b82f-5b1506b85f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:17.376736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:17.379598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:17.381184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ac283-91c1-4cb7-8647-ae0a8a37949a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.398051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 99/212] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:17.399260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13626-103b-4e4f-9c48-dd135b39bd93 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.399556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13626-103b-4e4f-9c48-dd135b39bd93 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.399838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b13626-103b-4e4f-9c48-dd135b39bd93 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.401269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 100/213] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:17.406350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.406640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.406926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.425107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:17.426294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:17.428606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.429480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.429764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.430039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.440645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:17.448384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:17.449304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:17.450108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 114/214] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:17.455247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.500607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 101/215] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:17.504924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.564027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a8695-f31f-4daf-a2f5-1f29191f0c96 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.598992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.599780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.600063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.600336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.610692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:17.618392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:17.619286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 115/216] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:17.625279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.637703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6a36-21b5-478d-be70-ada601f8cad9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.645818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:17.657649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:17.676893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.677562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.677842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.678111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.678856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:17.679162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:17.680517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:17.690549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 102/217] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:17.691447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.732050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548e946-ab7c-494a-87c6-dd3adcb4bc58 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.773680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.774474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.774759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.775042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.776216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:17.777689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:17.779637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 116/218] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:17.780412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.798455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82424d-4358-46dc-8f1d-635cf9ab103f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.833418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.834074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.834351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.834620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.835392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:17.835702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:17.837091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:17.845628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 103/219] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:17.846308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.878284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:17.889597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc2369-5b34-4536-b890-ee61da0df4f0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.895045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:17.926190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.927413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.927704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.927978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] PATH_INFO: `/v3/users/60c8914550c1436fbaa9d6cd9fb97298` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.944042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] RBAC: Authorizing `identity:get_user(user_id=60c8914550c1436fbaa9d6cd9fb97298)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:17.945637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:17.947630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 117/220] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/users/60c8914550c1436fbaa9d6cd9fb97298 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:17.952546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:17.957853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851be3-df62-42e3-bd24-ce7d80ffaf9d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:17.990807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:17.991466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:17.991748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:17.992021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:17.992755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:17.994180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.062264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741155-d59f-481b-b4c9-644c7d59a5ff None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.093707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 104/221] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:17 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:18.099332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d99d4-ca47-41fb-8fea-0bc6862efd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.100232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d99d4-ca47-41fb-8fea-0bc6862efd8d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.100513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d99d4-ca47-41fb-8fea-0bc6862efd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.100819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d99d4-ca47-41fb-8fea-0bc6862efd8d None admin] PATH_INFO: `/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.101853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.102126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d99d4-ca47-41fb-8fea-0bc6862efd8d None admin] RBAC: Authorizing `identity:get_user(user_id=6acc088cc58f4ac6a787a8bafc0a4dbe)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:18.103606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d99d4-ca47-41fb-8fea-0bc6862efd8d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.109763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 118/222] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:17 2022] GET /identity/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:18.111006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6092-9ffe-49ff-b068-8638d4ae3f19 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.111296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6092-9ffe-49ff-b068-8638d4ae3f19 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.111613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e6092-9ffe-49ff-b068-8638d4ae3f19 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.113374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 119/223] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:18.114019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6092-9ffe-49ff-b068-8638d4ae3f19 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.131169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:18.217741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:18.226972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1b26e-3317-43fc-b30d-aaf1dac03acd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.232986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e6092-9ffe-49ff-b068-8638d4ae3f19 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.267103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.267938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.273173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.273173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.273350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd3281-9177-482f-946c-9d0a9e5670f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.273350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd3281-9177-482f-946c-9d0a9e5670f6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.273350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd3281-9177-482f-946c-9d0a9e5670f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.273350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd3281-9177-482f-946c-9d0a9e5670f6 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.274134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd3281-9177-482f-946c-9d0a9e5670f6 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:18.275770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd3281-9177-482f-946c-9d0a9e5670f6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.277772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 120/224] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:18.278957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.279243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.279523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.298361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:18.299594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:18.350906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:18.352720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.386357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 121/225] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:18.387104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.404787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:18.468575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:18.478022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 105/226] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:18.483806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.517925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d670d-f75b-4b9e-b1b8-2175ee38a5d8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.570333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.571240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.571676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.572074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1/users/6acc088cc58f4ac6a787a8bafc0a4dbe/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.575233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=03be8df62f0948daa85a617126d106a1, user_id=6acc088cc58f4ac6a787a8bafc0a4dbe, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:18.576713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.606390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e004e9-dd5b-44c1-b171-dc66a062b446 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.642467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.644023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.644309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.644586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.650588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 122/227] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:18 2022] PUT /identity/v3/projects/03be8df62f0948daa85a617126d106a1/users/6acc088cc58f4ac6a787a8bafc0a4dbe/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:18.651978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.658772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:18.668766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:18.677807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 106/228] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:18.678615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.754554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:18.763596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:18.807900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b4b4-a394-46ec-b524-3bf45dab26a5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.869399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.870913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.871481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.873295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.875185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:18.877147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.878768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35216f02-f46f-454e-9e5f-1a390a61b5d3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:18.879472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 123/229] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:18.886112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:18.930275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:18.930945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:18.931231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:18.931508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:18.932270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:18.932578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:18.933989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:18.945033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 107/230] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:18.950234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:19.006081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a308215-4f0a-47cd-943a-29e9e9070ce1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:19.043430 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:19.044659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:19.045162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:19.045630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:19.046768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=60c8914550c1436fbaa9d6cd9fb97298) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:19.047376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:19.049059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:19.053596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b90fa6-dce9-4a1b-a473-2579f3637209 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:19.056449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 124/231] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/role_assignments?user.id=60c8914550c1436fbaa9d6cd9fb97298&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:19.080209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:19.106321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:19.107629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:19.108223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:19.108743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] PATH_INFO: `/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:19.110414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] RBAC: Authorizing `identity:get_user(user_id=6acc088cc58f4ac6a787a8bafc0a4dbe)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:19.119117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:19.121377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 108/232] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:18 2022] GET /identity/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:19.127036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:19.131547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:19.270396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfee60-087f-4d51-a10f-82c2763a20e4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:19.305619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f295e2c4-2151-4899-8b0c-b95a5daf1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:19.306833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e2c4-2151-4899-8b0c-b95a5daf1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:19.307355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e2c4-2151-4899-8b0c-b95a5daf1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:19.307826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295e2c4-2151-4899-8b0c-b95a5daf1cc0 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:19.309229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e2c4-2151-4899-8b0c-b95a5daf1cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:19.310871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f295e2c4-2151-4899-8b0c-b95a5daf1cc0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:19.312808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 125/233] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:19 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:19.318517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:19.454424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf72f79-4a25-4e46-b618-189a7c54be7b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:19.503844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf008a-6f38-4034-a692-7057e5a3ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:19.505294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf008a-6f38-4034-a692-7057e5a3ea6c None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:19.505793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf008a-6f38-4034-a692-7057e5a3ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:19.506309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf008a-6f38-4034-a692-7057e5a3ea6c None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1/users/6acc088cc58f4ac6a787a8bafc0a4dbe/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:19.512916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf008a-6f38-4034-a692-7057e5a3ea6c None admin] RBAC: Authorizing `identity:create_grant(project_id=03be8df62f0948daa85a617126d106a1, user_id=6acc088cc58f4ac6a787a8bafc0a4dbe, role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:19.514615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf008a-6f38-4034-a692-7057e5a3ea6c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:19.670444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 109/234] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:19 2022] PUT /identity/v3/projects/03be8df62f0948daa85a617126d106a1/users/6acc088cc58f4ac6a787a8bafc0a4dbe/roles/ef55a3c470c94814b91be114d41243c5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:20.850487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c54b-4eb3-498c-a694-157a248d0d55 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:20.851422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c54b-4eb3-498c-a694-157a248d0d55 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:20.851913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34c54b-4eb3-498c-a694-157a248d0d55 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:20.853681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 126/235] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:20.859210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978ee78-3d41-4ffb-8a76-2fce00513e33 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:20.860037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978ee78-3d41-4ffb-8a76-2fce00513e33 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:20.860514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978ee78-3d41-4ffb-8a76-2fce00513e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:20.878571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b978ee78-3d41-4ffb-8a76-2fce00513e33 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:20.880107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b978ee78-3d41-4ffb-8a76-2fce00513e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:20.922875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:20.951825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 110/236] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:20.976561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c54b-4eb3-498c-a694-157a248d0d55 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.057464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:21.089746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34c54b-4eb3-498c-a694-157a248d0d55 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.102564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013141-f3b3-40fe-8fde-aa7bda9666ca None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.103827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013141-f3b3-40fe-8fde-aa7bda9666ca None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.104585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013141-f3b3-40fe-8fde-aa7bda9666ca None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.107092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 111/237] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:21.116134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a9904-7007-4b27-b17c-1b82bdd3a150 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.116134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a9904-7007-4b27-b17c-1b82bdd3a150 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.116134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a9904-7007-4b27-b17c-1b82bdd3a150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.146976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b09a9904-7007-4b27-b17c-1b82bdd3a150 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:21.148205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b09a9904-7007-4b27-b17c-1b82bdd3a150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:21.159949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.160792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.161075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.161350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.177258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:21.184985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:21.185862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:21.186649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 127/238] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:21.191813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.266322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 112/239] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:21.270050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88a2ba-bd93-44a7-8d25-560cafdb70f3 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.270340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88a2ba-bd93-44a7-8d25-560cafdb70f3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.270614 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88a2ba-bd93-44a7-8d25-560cafdb70f3 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.272004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 113/240] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:21.280649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.280956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.281237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.305241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:21.306513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:21.323800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30981991-84cb-447b-857f-a6d76a11b05b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.362699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:21.369283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.370275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.370563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.377947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.377947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:21.377947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:21.377947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:21.385727 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 128/242] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:21.386546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.388744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 114/242] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:21.395597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.442188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:21.519726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbae056-7fb6-4fb4-9893-ade08f26a045 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.526013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dac313-6994-45f0-930d-8c6b39bcf2a3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.560441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d78c-42b9-4c03-80b5-3af002ae9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.561598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d78c-42b9-4c03-80b5-3af002ae9018 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.561919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d78c-42b9-4c03-80b5-3af002ae9018 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.562153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d78c-42b9-4c03-80b5-3af002ae9018 None admin] PATH_INFO: `/v3/users/cc13119a3249498f978b5f4e68488451` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.565298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.566097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.566383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.566662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.567831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:21.569301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:21.570933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 129/243] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:21.573494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.579787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d78c-42b9-4c03-80b5-3af002ae9018 None admin] RBAC: Authorizing `identity:get_user(user_id=cc13119a3249498f978b5f4e68488451)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:21.581833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76d78c-42b9-4c03-80b5-3af002ae9018 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:21.583529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 115/244] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:21 2022] GET /identity/v3/users/cc13119a3249498f978b5f4e68488451 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:21.584786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315bbc-327d-412b-8cb2-179c9936ba17 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.585072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315bbc-327d-412b-8cb2-179c9936ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.585358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315bbc-327d-412b-8cb2-179c9936ba17 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.586585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 116/245] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:21.587342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315bbc-327d-412b-8cb2-179c9936ba17 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.640730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:21.679736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:21.680833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaf9f6-979b-452b-b65d-797241a491dd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.690345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315bbc-327d-412b-8cb2-179c9936ba17 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.715641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.716429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.716736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.717015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.726734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:21.727637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d37157-81af-4e78-8708-1179e4d7b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.728299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37157-81af-4e78-8708-1179e4d7b939 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.728586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37157-81af-4e78-8708-1179e4d7b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.728885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d37157-81af-4e78-8708-1179e4d7b939 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.729596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37157-81af-4e78-8708-1179e4d7b939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:21.731033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d37157-81af-4e78-8708-1179e4d7b939 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:21.734360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:21.735206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:21.736038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 130/246] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:21.741894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.836134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 117/247] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:21 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:21.844848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a67a6-9e73-44b3-8d9d-bfff4bc32203 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:21.846624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.846915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.847921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.868205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:21.873888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:21.875254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:21.883692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:21.884357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:21.884792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:21.885073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:21.984441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 118/248] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:21.985363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:21.985473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:21.987220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.087673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:22.111729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f509fe-cf52-48cb-9174-30ece1986347 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.128712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 131/249] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:22.129458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.156876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:22.162599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.163578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.164065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.164533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.165552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:22.166079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.176221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.177148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 119/250] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:22.178146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.252157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef01c0-21df-4774-b064-89470fd96477 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.296863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.298046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.298488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.298918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.306057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae31685-3f1e-4e87-af95-853bc7b3d96e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.311958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:22.320788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:22.321758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:22.322543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:22.325584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 132/251] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:22.326686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.353130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.354364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.354891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.355376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.356845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.358564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.360513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 120/252] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:22.361571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.379141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:22.446563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:22.469824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4acf5-6050-48e7-9149-e7c94c217ca2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.477646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f195c-bf1b-460d-ad2b-44e92c73b08f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.509191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.510473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.510897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.511401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] PATH_INFO: `/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.512789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] RBAC: Authorizing `identity:get_user(user_id=6acc088cc58f4ac6a787a8bafc0a4dbe)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.514562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.516871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 133/253] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:22.518324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.526695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.527666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.528180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.528701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.529724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:22.530229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.531872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e984bb-6fad-4899-8a5c-c945ea2c2ef8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.544767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 121/254] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:22.546437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fde10-20c7-495f-b590-c78177f20e31 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.546931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fde10-20c7-495f-b590-c78177f20e31 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.547402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fde10-20c7-495f-b590-c78177f20e31 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.549075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 122/255] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:22.550383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fde10-20c7-495f-b590-c78177f20e31 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.628646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:22.647786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551325dd-370a-4141-8da4-fb2869ba8867 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.665383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76fde10-20c7-495f-b590-c78177f20e31 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.688438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.689521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.690632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.691157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.692211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] RBAC: Adding query filter params (role.id=02a07d0fba054284b839937e5b867451, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=cc13119a3249498f978b5f4e68488451) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:22.692777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.694780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.701562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 134/256] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/role_assignments?user.id=cc13119a3249498f978b5f4e68488451&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=02a07d0fba054284b839937e5b867451 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:22.702680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:22.706138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.707826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.708200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.708574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.721396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:22.827947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47da1c-11ce-4d4f-b831-13fcd66b6dfe None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:22.846531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.848032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.890323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2dd3b-41b3-4958-9582-b571a50f5eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:22.891243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2dd3b-41b3-4958-9582-b571a50f5eea None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.891527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2dd3b-41b3-4958-9582-b571a50f5eea None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.891802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2dd3b-41b3-4958-9582-b571a50f5eea None admin] PATH_INFO: `/v3/users/60c8914550c1436fbaa9d6cd9fb97298` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.893926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2dd3b-41b3-4958-9582-b571a50f5eea None admin] RBAC: Authorizing `identity:get_user(user_id=60c8914550c1436fbaa9d6cd9fb97298)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:22.895391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2dd3b-41b3-4958-9582-b571a50f5eea None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:22.907311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 135/257] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/users/60c8914550c1436fbaa9d6cd9fb97298 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:22.908857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88297-8123-412b-9200-90329748b068 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:22.909148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88297-8123-412b-9200-90329748b068 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:22.909431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88297-8123-412b-9200-90329748b068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:22.928401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-67f88297-8123-412b-9200-90329748b068 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:22.930795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-67f88297-8123-412b-9200-90329748b068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:22.967150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:23.014048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 123/258] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:23.014724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:23.015874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 136/259] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:23.021257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88297-8123-412b-9200-90329748b068 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:23.041757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:23.147329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88297-8123-412b-9200-90329748b068 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:23.194770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:23.195993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:23.196475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:23.196969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:23.198409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:23.200236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:23.204523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 137/260] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:23 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:23.205590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:23.253921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe39d1b-0e20-463f-9ac3-c50e85a38a16 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:23.320177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:23.321627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:23.323582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:23.324246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:23.327928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:23.329623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:23.333127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 124/261] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:23 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:23.335090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:23.357189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:23.390147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7f8de-1e41-4756-9941-8cd675ddce98 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:23.420983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:23.453072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:23.453937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:23.454217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:23.454493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:23.477556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:23.488225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:23.489222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 138/262] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:23.490396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:23.524335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d47349-3710-49f9-852a-b0b4781f0adc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:23.597417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:23.599353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:23.599674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:23.599960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:23.600828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=6acc088cc58f4ac6a787a8bafc0a4dbe) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:23.601143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:23.606476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:23.619842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 125/263] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:23 2022] GET /identity/v3/role_assignments?user.id=6acc088cc58f4ac6a787a8bafc0a4dbe&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:23.620715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:23.696398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5647c-c21b-4d66-a62f-2b49f28b6c60 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:23.744682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:23.745601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:23.745883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:23.746157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1/users/60c8914550c1436fbaa9d6cd9fb97298/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:23.749256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] RBAC: Authorizing `identity:create_grant(project_id=03be8df62f0948daa85a617126d106a1, user_id=60c8914550c1436fbaa9d6cd9fb97298, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:23.750765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:23.815113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fdbe01-ed06-4efd-b853-da9d25bd6fb3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:23.829315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:23.843237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:23.848062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 139/264] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:23 2022] PUT /identity/v3/projects/03be8df62f0948daa85a617126d106a1/users/60c8914550c1436fbaa9d6cd9fb97298/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:23.863700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:23.864387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:23.864705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:23.864994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:23.865775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:23.866089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:23.867484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:23.877200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 126/265] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:23.882990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:24.007837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9084f5-d8db-47b0-bd79-29777648e67f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:24.044837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:24.045719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.045999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.046273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] PATH_INFO: `/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.047572 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] RBAC: Authorizing `identity:get_user(user_id=6acc088cc58f4ac6a787a8bafc0a4dbe)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:24.049107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:24.051239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 140/266] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:23 2022] GET /identity/v3/users/6acc088cc58f4ac6a787a8bafc0a4dbe => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:24.056729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:24.171062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e39a-25bd-4e5a-be63-6e4a5ccc8728 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:24.207032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f451245b-2148-4b9c-b7bf-e01077361249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:24.207746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451245b-2148-4b9c-b7bf-e01077361249 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.208033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451245b-2148-4b9c-b7bf-e01077361249 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.208365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f451245b-2148-4b9c-b7bf-e01077361249 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.245011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:24.280720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451245b-2148-4b9c-b7bf-e01077361249 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:24.282118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f451245b-2148-4b9c-b7bf-e01077361249 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:24.385181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 127/267] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:24.390836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:24.516887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:24.540809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d829c-8da0-4d97-a405-6f63623206ed None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.541086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d829c-8da0-4d97-a405-6f63623206ed None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.541299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d829c-8da0-4d97-a405-6f63623206ed None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.542956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 128/268] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:24.558127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.558412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.558688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.583827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:24.585050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:24.590695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ff4e6-15eb-4692-99ea-85daa849cada None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:24.654635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57186595-ecac-4241-a246-65341af2f583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:24.655495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57186595-ecac-4241-a246-65341af2f583 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.655776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57186595-ecac-4241-a246-65341af2f583 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.656050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57186595-ecac-4241-a246-65341af2f583 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.661822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57186595-ecac-4241-a246-65341af2f583 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:24.663379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57186595-ecac-4241-a246-65341af2f583 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:24.665425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 141/269] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:24 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:24.672746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57186595-ecac-4241-a246-65341af2f583 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:24.711528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:24.730872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 129/270] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:24.779302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:24.792013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57186595-ecac-4241-a246-65341af2f583 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:24.826807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:24.827466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.827747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.828023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.828884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] RBAC: Adding query filter params (role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=6acc088cc58f4ac6a787a8bafc0a4dbe) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:24.829204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:24.830693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d91e62-466f-4933-ad48-3ea4406f6fda None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:24.833629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:24.837271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 142/271] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:24 2022] GET /identity/v3/role_assignments?user.id=6acc088cc58f4ac6a787a8bafc0a4dbe&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ef55a3c470c94814b91be114d41243c5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:24.838522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299b8e8-9d55-4d1c-8266-3ebb74a1c2f4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.838811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299b8e8-9d55-4d1c-8266-3ebb74a1c2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.839088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299b8e8-9d55-4d1c-8266-3ebb74a1c2f4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.844378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 143/272] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:24.847909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:24.848203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:24.852105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:24.890508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:24.891862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:24.947212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba1d4-2422-4bf5-88d4-ac997997752e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.020423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.021668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.022139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.022581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.027851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 144/273] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:25.041081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:25.050004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:25.050860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:25.051642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:25.056074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.057143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 130/274] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:14:25.062361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.143813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:25.182095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79575c-13d9-4803-9384-b4a203a2771c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.197683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d1abb-5f09-45db-a68c-c66318c77cab None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.225183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:25.233246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.235299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.235763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.236207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.238450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:25.240246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.241112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.241559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.241974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.242808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:25.243014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:25.243481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:25.244482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 145/275] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:25.248434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:25.250855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.262754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 131/276] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:25.268673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.369086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce046f-96e4-48e0-baf9-9fb37ec26d12 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.377885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e34e32-0f15-40e9-bd18-f851bc90e8e6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.395859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:25.407265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbc12d-50a8-48ff-bc6d-7c187427d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.408185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc12d-50a8-48ff-bc6d-7c187427d36a None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.409020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc12d-50a8-48ff-bc6d-7c187427d36a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.409330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbc12d-50a8-48ff-bc6d-7c187427d36a None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.410536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbc12d-50a8-48ff-bc6d-7c187427d36a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:25.411835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbc12d-50a8-48ff-bc6d-7c187427d36a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:25.415162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32469784-ef6b-4584-a74e-061050e1b39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.416028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32469784-ef6b-4584-a74e-061050e1b39f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.416313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32469784-ef6b-4584-a74e-061050e1b39f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.416584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32469784-ef6b-4584-a74e-061050e1b39f None admin] PATH_INFO: `/v3/users/c1bde1ca21854fb7a852ff9396fa80ec` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.431277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32469784-ef6b-4584-a74e-061050e1b39f None admin] RBAC: Authorizing `identity:get_user(user_id=c1bde1ca21854fb7a852ff9396fa80ec)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:25.432852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32469784-ef6b-4584-a74e-061050e1b39f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:25.434650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 132/277] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/users/c1bde1ca21854fb7a852ff9396fa80ec => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:25.435877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee868b-4c43-482f-8e42-3824689b8a2f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.436165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee868b-4c43-482f-8e42-3824689b8a2f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.436441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee868b-4c43-482f-8e42-3824689b8a2f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.440751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 133/278] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:25.441789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee868b-4c43-482f-8e42-3824689b8a2f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.496655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 146/279] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:25 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:25.496655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.496655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.496655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.516942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:25.518827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:25.557013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eee868b-4c43-482f-8e42-3824689b8a2f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.592181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:25.596145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.597154 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.597644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.598101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.599201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, user.id=c1bde1ca21854fb7a852ff9396fa80ec, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:25.599747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:25.601431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:25.607668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 134/280] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/role_assignments?user.id=c1bde1ca21854fb7a852ff9396fa80ec&scope.system=all&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:25.614947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 147/281] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:25.638330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.688336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:25.759280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1890b8-6478-4016-9cbe-6a2f2aa3ee60 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.797901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.799029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.799578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.799853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.810738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:25.819009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:25.819892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:25.820715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 135/282] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:25.826205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:25.930005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3185f-10f2-47eb-b729-b934c2bb8dfa None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:25.966756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:25.967481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:25.967766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:25.968041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:25.968827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:25.969132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:25.970566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:25.979546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 148/283] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:25.985014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:26.099216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:26.104398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc8265-9259-4abb-8e84-f8cf6fb1f425 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:26.143172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:26.144051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.144330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.144603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] PATH_INFO: `/v3/users/cc13119a3249498f978b5f4e68488451` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.145847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc13119a3249498f978b5f4e68488451)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:26.147296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:26.149337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 136/284] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:25 2022] GET /identity/v3/users/cc13119a3249498f978b5f4e68488451 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:26.154781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:26.219137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:26.279731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af994d-620a-467d-b94e-e0f8a10dc865 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:26.313765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12527c8-ae5a-4664-a3aa-efe5a3f56204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:26.315186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12527c8-ae5a-4664-a3aa-efe5a3f56204 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.315464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12527c8-ae5a-4664-a3aa-efe5a3f56204 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.315738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12527c8-ae5a-4664-a3aa-efe5a3f56204 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.316957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12527c8-ae5a-4664-a3aa-efe5a3f56204 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:26.318392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12527c8-ae5a-4664-a3aa-efe5a3f56204 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:26.320099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 149/285] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:26 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:26.326135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:26.442737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb997c6-abd2-4c0c-821f-722f42141322 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.443082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb997c6-abd2-4c0c-821f-722f42141322 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.443292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb997c6-abd2-4c0c-821f-722f42141322 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.444826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 150/286] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:26.450303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.450591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.450867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.454115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236496f6-9cfc-4d21-a3d9-c9162be10be2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:26.468053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:26.469649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:26.541373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:26.542284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.542562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.542832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1/users/cc13119a3249498f978b5f4e68488451/roles/02a07d0fba054284b839937e5b867451` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.553525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] RBAC: Authorizing `identity:create_grant(project_id=03be8df62f0948daa85a617126d106a1, user_id=cc13119a3249498f978b5f4e68488451, role_id=02a07d0fba054284b839937e5b867451)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:26.554994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:26.559497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 151/287] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:26.584558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:26.627351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 137/288] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:14:26 2022] PUT /identity/v3/projects/03be8df62f0948daa85a617126d106a1/users/cc13119a3249498f978b5f4e68488451/roles/02a07d0fba054284b839937e5b867451 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:14:26.644807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:26.733034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0168b-ea22-4a27-a007-950be8aa033b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:26.779665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:26.780475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.780788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.781067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.792627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:26.801249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:26.802194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:26.802980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 152/289] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:14:26.810338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:26.851428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:26.949260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c3ac6-7113-4c94-990f-114210a725db None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:26.988470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:26.989509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:26.989989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:26.990476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:26.991427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:26.991947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:26.993540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:27.004341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 138/290] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:27.011069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:27.157397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370d504-1308-49cf-8fd5-d8ce1be478c5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:27.160648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:27.199947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:27.201352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:27.201862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:27.202397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] PATH_INFO: `/v3/users/60c8914550c1436fbaa9d6cd9fb97298` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:27.203872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] RBAC: Authorizing `identity:get_user(user_id=60c8914550c1436fbaa9d6cd9fb97298)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:27.205713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:27.207920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 153/291] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:27 2022] GET /identity/v3/users/60c8914550c1436fbaa9d6cd9fb97298 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:27.212996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:27.308199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:27.327471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede93ed8-aa1e-4ed7-9b89-6820d24cddac None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:27.380086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:27.380757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:27.381047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:27.381328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:27.479977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:27.481499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:27.581112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:27.593922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 139/292] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:14:27.599814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:27.755688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824dc45-5e0a-4b60-996c-ca1216c990ea None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:27.802223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27350f1-c429-46ed-b170-2e9556278c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:27.803100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27350f1-c429-46ed-b170-2e9556278c01 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:27.803382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27350f1-c429-46ed-b170-2e9556278c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:27.803658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27350f1-c429-46ed-b170-2e9556278c01 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:27.804907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27350f1-c429-46ed-b170-2e9556278c01 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:27.806351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27350f1-c429-46ed-b170-2e9556278c01 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:27.808077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 154/293] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:27 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:27.814122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:27.943410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63d289-2d46-4225-9333-6affdcf965e1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:27.994375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:27.995090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:27.995378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:27.995710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:27.996558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=60c8914550c1436fbaa9d6cd9fb97298) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:27.996900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:27.998336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328128e-b37f-431f-8d53-d1a1bca43838 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:28.009389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 140/294] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:27 2022] GET /identity/v3/role_assignments?user.id=60c8914550c1436fbaa9d6cd9fb97298&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:28.223786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630893d7-4e53-4870-9cb4-6aeeeeaa1c04 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.224264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630893d7-4e53-4870-9cb4-6aeeeeaa1c04 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.224264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630893d7-4e53-4870-9cb4-6aeeeeaa1c04 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.225895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 155/295] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:28.231221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.231629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.231794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.254512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:28.255710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:28.315058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:28.339788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 141/296] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:28.362019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630893d7-4e53-4870-9cb4-6aeeeeaa1c04 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:28.419602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:28.483218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630893d7-4e53-4870-9cb4-6aeeeeaa1c04 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:28.523002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51405b-00d7-4dc8-ab73-6be9254eef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:28.523811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51405b-00d7-4dc8-ab73-6be9254eef50 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.524160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51405b-00d7-4dc8-ab73-6be9254eef50 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.524442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51405b-00d7-4dc8-ab73-6be9254eef50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.536073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51405b-00d7-4dc8-ab73-6be9254eef50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-cd51405b-00d7-4dc8-ab73-6be9254eef50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:28.544054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:28.544951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:28.545749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 156/297] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:28.554085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:28.578468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9960c0-f640-4348-9d1f-28ad853cf5d8 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.578837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9960c0-f640-4348-9d1f-28ad853cf5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.579183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9960c0-f640-4348-9d1f-28ad853cf5d8 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.581429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 157/298] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:28.586189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87979d2-1512-4902-82bb-bf32ba1ce3d7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.586542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87979d2-1512-4902-82bb-bf32ba1ce3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.586893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87979d2-1512-4902-82bb-bf32ba1ce3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.605725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e87979d2-1512-4902-82bb-bf32ba1ce3d7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:28.607795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e87979d2-1512-4902-82bb-bf32ba1ce3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:28.682486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2cdf6-3772-49ad-80ad-07f00c53acd1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:28.697048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 158/299] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:28.698652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113747-91e6-406a-a70d-3be3896a4b25 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.698942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113747-91e6-406a-a70d-3be3896a4b25 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.699215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113747-91e6-406a-a70d-3be3896a4b25 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.700759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 159/300] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:28.706051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.706364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.706650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.724065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:28.725336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:28.729292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:28.729963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.730247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.730522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.731278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:28.731589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:28.732989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:28.741319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 142/301] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:28.742132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:28.749323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:28.793553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 160/302] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:28.794658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:28.797488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:28.863578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5e180-19c6-4213-80de-8163faddc018 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:28.898581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:28.899368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.899656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.899927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.910498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:28.914733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0bc06-62fe-4365-a774-e9bc45551acd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:28.918136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:28.919002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 143/303] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:28.925112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:28.953212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:28.954081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:28.954363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:28.955195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] PATH_INFO: `/v3/users/c1bde1ca21854fb7a852ff9396fa80ec` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:28.956380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] RBAC: Authorizing `identity:get_user(user_id=c1bde1ca21854fb7a852ff9396fa80ec)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:28.957840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:28.959754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 161/304] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:28 2022] GET /identity/v3/users/c1bde1ca21854fb7a852ff9396fa80ec => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:28.960519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:28.991889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:29.035934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859fae73-afc2-4872-ad03-72b48bb1fd0f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.039062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:29.066518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b5dc64-062b-4ad2-8964-fbca58de6496 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.071913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.072828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.073115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.073392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.074569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.076014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.077822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 144/305] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:29.078391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:29.105606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.106276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.106562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.106840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.107617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:29.107957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.109370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.117481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 162/306] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:29.122488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:29.187518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca27a2-fe8b-432d-be04-e5e91d4b41e5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.219960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:29.224636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.225704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.226159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.226704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] PATH_INFO: `/v3/system/users/c1bde1ca21854fb7a852ff9396fa80ec/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.228348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c1bde1ca21854fb7a852ff9396fa80ec, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.233042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9b7d3-ab1e-43da-a722-3cb76de11b51 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.233479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.266183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051597d-008d-45a9-ad51-b7dafeb3564f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.266780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051597d-008d-45a9-ad51-b7dafeb3564f None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.267098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051597d-008d-45a9-ad51-b7dafeb3564f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.267509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051597d-008d-45a9-ad51-b7dafeb3564f None admin] PATH_INFO: `/v3/groups` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.268253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051597d-008d-45a9-ad51-b7dafeb3564f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.269779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051597d-008d-45a9-ad51-b7dafeb3564f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.332853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 145/307] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Jun 16 20:14:29 2022] PUT /identity/v3/system/users/c1bde1ca21854fb7a852ff9396fa80ec/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:29.333999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:29.380653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 163/308] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Jun 16 20:14:29 2022] POST /identity/v3/groups => generated 229 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:29.380653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533795-7887-4b25-809c-fbe0737a9364 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.380653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533795-7887-4b25-809c-fbe0737a9364 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.380653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39533795-7887-4b25-809c-fbe0737a9364 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.380653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 164/309] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:29.382178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:29.387517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.387854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.388137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.413031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:29.414304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:29.464503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67618649-ef1b-46bc-a52d-ac1a254529af None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.505873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.506781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.507067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.507438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] PATH_INFO: `/v3/users/368de85db37a4cc28cba556d3c4b310a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.527554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 165/310] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:29.527723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] RBAC: Authorizing `identity:get_user(user_id=368de85db37a4cc28cba556d3c4b310a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.529454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.531545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 146/311] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:29 2022] GET /identity/v3/users/368de85db37a4cc28cba556d3c4b310a => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:29.537878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:29.552871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:29.646114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:29.662294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:29.666060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e766b2-35da-4131-b527-17d80dd0b90d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.668081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef10521-b8ef-431e-a832-b137d3b41e61 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.703307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.704091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.704368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.704687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.710253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.711204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.711583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.712114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.713405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] RBAC: Adding query filter params (role.id=02a07d0fba054284b839937e5b867451, user.id=368de85db37a4cc28cba556d3c4b310a, scope.system=all) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:29.717017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.717017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.717206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:29.721778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 166/312] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jun 16 20:14:29 2022] GET /identity/v3/role_assignments?user.id=368de85db37a4cc28cba556d3c4b310a&scope.system=all&role.id=02a07d0fba054284b839937e5b867451 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:29.725145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:29.726051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:29.726845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 147/313] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:14:29.733690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:29.854341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea32dda5-7054-4401-8247-7b2af590693b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:29.895871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:29.896220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:29.896508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:29.896813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:29.897601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:29.897911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:29.899292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:29.908701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 167/314] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:29.914120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:30.016502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0107805-89f9-4916-85d3-3863edb9f9dd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:30.050942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:30.052186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:30.052690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:30.053180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] PATH_INFO: `/v3/users/cc13119a3249498f978b5f4e68488451` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:30.054576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] RBAC: Authorizing `identity:get_user(user_id=cc13119a3249498f978b5f4e68488451)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:30.056210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:30.058375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 148/315] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:29 2022] GET /identity/v3/users/cc13119a3249498f978b5f4e68488451 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:30.063975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:30.077482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:30.174373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cffdb97-50d8-456c-879b-3ec5643d4fb6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:30.209177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:30.209825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:30.210116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:30.210394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:30.286240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:30.288530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:30.297176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:30.392934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 168/316] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:30.399042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:30.426579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:30.507875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8f257-977b-4521-adda-b0144dd63873 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:30.547216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11253c17-61b4-44e0-bd2f-67df05e5c6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:30.548128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11253c17-61b4-44e0-bd2f-67df05e5c6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:30.548416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11253c17-61b4-44e0-bd2f-67df05e5c6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:30.549053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11253c17-61b4-44e0-bd2f-67df05e5c6d4 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:30.550264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11253c17-61b4-44e0-bd2f-67df05e5c6d4 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:30.554743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11253c17-61b4-44e0-bd2f-67df05e5c6d4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:30.556818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 149/317] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:30 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:30.562735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:30.672819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cec73-d1dd-47cc-b4f1-c47fd69c33c1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:30.681616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:30.709604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:30.710601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:30.711088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:30.711557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:30.712573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] RBAC: Adding query filter params (role.id=02a07d0fba054284b839937e5b867451, scope.project.id=03be8df62f0948daa85a617126d106a1, user.id=cc13119a3249498f978b5f4e68488451) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:30.713115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:30.714710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6387a56-2b5d-4929-82a5-fc56f7fb2264 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:30.721266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 169/318] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:30 2022] GET /identity/v3/role_assignments?user.id=cc13119a3249498f978b5f4e68488451&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=02a07d0fba054284b839937e5b867451 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:31.523377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420126-2853-4aa5-b023-41b4e79ff975 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.523893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420126-2853-4aa5-b023-41b4e79ff975 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.523893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39420126-2853-4aa5-b023-41b4e79ff975 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.525460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 150/319] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:31.530393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7126-0fcf-419b-bcdf-20fbe537d4e4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.530783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7126-0fcf-419b-bcdf-20fbe537d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.530943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e7126-0fcf-419b-bcdf-20fbe537d4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.549031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-264e7126-0fcf-419b-bcdf-20fbe537d4e4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:31.550216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-264e7126-0fcf-419b-bcdf-20fbe537d4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:31.622107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 170/320] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:31.646142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39420126-2853-4aa5-b023-41b4e79ff975 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:31.672500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819cd1-1104-4f0d-a898-520e7e675553 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.672888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819cd1-1104-4f0d-a898-520e7e675553 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.673132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a819cd1-1104-4f0d-a898-520e7e675553 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.675064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 171/321] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:31.679790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.680078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.680359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.696340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:31.697558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:31.742301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:31.753778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39420126-2853-4aa5-b023-41b4e79ff975 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:31.764584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 172/322] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:31.787857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:31.789253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:31.790049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.790331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.790602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.801195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:31.808720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:31.809590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:31.811210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 151/323] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:31.816209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:31.820321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:31.896946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdd48c-ebb5-4600-9089-2f3c0b0e632f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:31.926567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308039-aae7-4da7-bb59-3570917dff69 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:31.931077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc1c1b-5f44-4ffe-860a-9aa7b98f0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:31.931878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc1c1b-5f44-4ffe-860a-9aa7b98f0868 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.932165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc1c1b-5f44-4ffe-860a-9aa7b98f0868 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.932442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc1c1b-5f44-4ffe-860a-9aa7b98f0868 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.933638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc1c1b-5f44-4ffe-860a-9aa7b98f0868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:31.935069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc1c1b-5f44-4ffe-860a-9aa7b98f0868 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:31.936719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 173/324] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:31.938012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568643b-aea8-4aff-8b3b-2f5ab01cfb02 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.938304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568643b-aea8-4aff-8b3b-2f5ab01cfb02 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.939115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568643b-aea8-4aff-8b3b-2f5ab01cfb02 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.940453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 174/325] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:31.942777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568643b-aea8-4aff-8b3b-2f5ab01cfb02 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:31.960729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:31.961391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.961676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.961950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.962705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:31.963013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:31.964400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5b070-4a68-486e-8b21-d6441b1f40b4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:31.972341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 152/326] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:31.972341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:31.972341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:31.972341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:31.989920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:31.991137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:31.998511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:32.042520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:32.047059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568643b-aea8-4aff-8b3b-2f5ab01cfb02 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.056252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 153/327] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:32.068770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:32.082662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.083325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.083612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.083887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] PATH_INFO: `/v3/groups` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.084581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:32.086046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:32.153625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f2e92-6aa8-40b6-8c61-d60ff3a44894 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.177486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 175/328] 10.222.0.65 () {60 vars in 1134 bytes} [Thu Jun 16 20:14:31 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:14:32.181614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:32.187900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.189601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.189881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.190152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] PATH_INFO: `/v3/users/c1bde1ca21854fb7a852ff9396fa80ec` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.191523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] RBAC: Authorizing `identity:get_user(user_id=c1bde1ca21854fb7a852ff9396fa80ec)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:32.193261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:32.195231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 154/329] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:32 2022] GET /identity/v3/users/c1bde1ca21854fb7a852ff9396fa80ec => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:32.201092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:32.215041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:32.294857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fcd0f4-5824-4e97-a03f-b9946490d7bb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.315744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b74d2e-8564-43a1-8898-973853497e77 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.334294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.335100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.335384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.335660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.347108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:32.350754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.351409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.351694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.351972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.352847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] RBAC: Adding query filter params (role.id=ebb073838eae41259f93a5ed2bc31346, user.id=c1bde1ca21854fb7a852ff9396fa80ec, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:32.353164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:32.354598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:32.354911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:32.355751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:32.356532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 176/330] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:32.363760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:32.368227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 155/331] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jun 16 20:14:32 2022] GET /identity/v3/role_assignments?user.id=c1bde1ca21854fb7a852ff9396fa80ec&scope.system=all&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 510 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:32.390476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:32.522745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8f1ea-414c-437b-8ed2-d2091d3dfc25 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.566915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.567507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.567790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.568068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.568859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:32.569167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:32.570568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:32.580128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 177/332] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:32.585533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:32.666036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:32.699512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca81c4-e50d-4ba8-a2de-18ac65c867d9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.733898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48459a8b-7b9e-49d3-8051-4fc83b216ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.734730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459a8b-7b9e-49d3-8051-4fc83b216ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.735013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459a8b-7b9e-49d3-8051-4fc83b216ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.735321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48459a8b-7b9e-49d3-8051-4fc83b216ee8 None admin] PATH_INFO: `/v3/users/368de85db37a4cc28cba556d3c4b310a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.736553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48459a8b-7b9e-49d3-8051-4fc83b216ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=368de85db37a4cc28cba556d3c4b310a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:32.738013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48459a8b-7b9e-49d3-8051-4fc83b216ee8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:32.739653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 156/333] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:32 2022] GET /identity/v3/users/368de85db37a4cc28cba556d3c4b310a => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:32.745446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:32.834836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:32.854591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88a212-309a-4cfc-a2bd-d096bcc7e3e5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:32.890333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f7f24-1f7c-47b1-b3b5-9d826661e6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:32.891567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7f24-1f7c-47b1-b3b5-9d826661e6b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:32.892569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7f24-1f7c-47b1-b3b5-9d826661e6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:32.893068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f7f24-1f7c-47b1-b3b5-9d826661e6b8 None admin] PATH_INFO: `/v3/system/users/368de85db37a4cc28cba556d3c4b310a/roles/02a07d0fba054284b839937e5b867451` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:32.894793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7f24-1f7c-47b1-b3b5-9d826661e6b8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=368de85db37a4cc28cba556d3c4b310a, role_id=02a07d0fba054284b839937e5b867451)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:32.896347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f7f24-1f7c-47b1-b3b5-9d826661e6b8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:32.972186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 178/334] 10.222.0.65 () {58 vars in 1334 bytes} [Thu Jun 16 20:14:32 2022] PUT /identity/v3/system/users/368de85db37a4cc28cba556d3c4b310a/roles/02a07d0fba054284b839937e5b867451 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:34.690231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435bc8-d947-46ca-81c5-80785025f170 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:34.691186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435bc8-d947-46ca-81c5-80785025f170 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:34.691655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435bc8-d947-46ca-81c5-80785025f170 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:34.693512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 157/335] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:34.698635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:34.699478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:34.699964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:34.721262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:34.722772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:34.800193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 179/336] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:34.840396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435bc8-d947-46ca-81c5-80785025f170 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:34.957265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435bc8-d947-46ca-81c5-80785025f170 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:34.994775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:34.995915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:34.996418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:34.996933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:34.999842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:35.013159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:35.022410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:35.023289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:35.024078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 158/337] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:35.027958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:35.126005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:35.152319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5621-6cfe-4ee5-9257-26f9ddf7528b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:35.193109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:35.194110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.194596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.195050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.196019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:35.196535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:35.198121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:35.208207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 180/338] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:35.214629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:35.341500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7544788-f6cf-4e76-b955-c0e98557acae None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:35.385667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df29db5-0f37-4cdd-a341-c35df0b078b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:35.386242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29db5-0f37-4cdd-a341-c35df0b078b3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.386579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29db5-0f37-4cdd-a341-c35df0b078b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.386864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df29db5-0f37-4cdd-a341-c35df0b078b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.459905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:35.467618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df29db5-0f37-4cdd-a341-c35df0b078b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:35.469126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df29db5-0f37-4cdd-a341-c35df0b078b3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:35.608588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 159/339] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:35.611576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:35.739479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9fee-e67e-4094-b4fc-32b6c00d0503 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.740465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9fee-e67e-4094-b4fc-32b6c00d0503 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.740961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be9fee-e67e-4094-b4fc-32b6c00d0503 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.742563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 160/340] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:35.746372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08829b-d6b7-47d9-9009-15789c656362 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:35.747623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625872-e031-4a05-bbbf-7e21189c34ca None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.748145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625872-e031-4a05-bbbf-7e21189c34ca None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.748652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625872-e031-4a05-bbbf-7e21189c34ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.780439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-50625872-e031-4a05-bbbf-7e21189c34ca None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:35.782044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-50625872-e031-4a05-bbbf-7e21189c34ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:35.790775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:35.791870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.792301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.792772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.794146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:35.796181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:35.798673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 181/341] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:35 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:35.804454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:35.808758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:35.927096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808a9a5-d4e9-4f5c-97e0-a7626d7a151a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:35.960247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 161/342] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:35.962158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d60d0-f23e-4cc3-93fc-5391063f21ee None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.962656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d60d0-f23e-4cc3-93fc-5391063f21ee None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.963164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d60d0-f23e-4cc3-93fc-5391063f21ee None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.964657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 162/343] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:35.967443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:35.968460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.968899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.969373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.970323 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:35.970713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:35.971096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:35.976580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:35.979242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:35.981139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 182/344] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:35 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:35.988282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:35.993525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:35.994984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:36.033278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:36.106268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:36.130010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 163/345] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:36.130946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:36.161150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c916161-0e2f-425f-b13c-187c24c45b15 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:36.215348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:36.216305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.216817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.217246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.218323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=f97693405a1044c69788e4853614cb54) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:36.218781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:36.220539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:36.228172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 183/346] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:35 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 260 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:36.229344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:36.296740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822bf71-4f5d-4fc0-9b1c-cd713fb0b7a4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:36.387768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb92a9-7d3c-446b-8845-8483e77b2527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:36.389020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb92a9-7d3c-446b-8845-8483e77b2527 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.389446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb92a9-7d3c-446b-8845-8483e77b2527 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.389862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb92a9-7d3c-446b-8845-8483e77b2527 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.417290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c45d6-e1bb-4442-9e83-5548f6998ad6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:36.424197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb92a9-7d3c-446b-8845-8483e77b2527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f0eb92a9-7d3c-446b-8845-8483e77b2527 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:36.438048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:36.439027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:36.440292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 164/347] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:36.441137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655419c-b1d2-4c6a-8d83-275b230362d0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.441386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655419c-b1d2-4c6a-8d83-275b230362d0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.441595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655419c-b1d2-4c6a-8d83-275b230362d0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.443313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 165/348] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:36.444377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eee7-a948-46ee-846e-0ddafbbfbb1c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.444719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eee7-a948-46ee-846e-0ddafbbfbb1c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.444956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eee7-a948-46ee-846e-0ddafbbfbb1c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.449989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 166/349] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:36.449989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7eee7-a948-46ee-846e-0ddafbbfbb1c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:36.473387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:36.479394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:36.486054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bd79d-949e-47a8-ba7e-a3b5080d483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:36.487174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd79d-949e-47a8-ba7e-a3b5080d483d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.487461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd79d-949e-47a8-ba7e-a3b5080d483d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.487897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bd79d-949e-47a8-ba7e-a3b5080d483d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.502142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bd79d-949e-47a8-ba7e-a3b5080d483d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-950bd79d-949e-47a8-ba7e-a3b5080d483d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:36.514242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:36.515210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:36.516025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:36.520162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 184/350] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:36.520162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0236a6-434c-4a69-8202-77d6b47156f1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.520162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0236a6-434c-4a69-8202-77d6b47156f1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.520162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0236a6-434c-4a69-8202-77d6b47156f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.541057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bd0236a6-434c-4a69-8202-77d6b47156f1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:36.542266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd0236a6-434c-4a69-8202-77d6b47156f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:36.578766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7eee7-a948-46ee-846e-0ddafbbfbb1c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:36.633447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:36.634114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.634388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.634661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.635425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:36.635730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:36.637150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:36.646083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 185/351] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:36.647776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.648072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.648353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.649491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 167/352] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:36.650319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:36.685686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:36.686875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:36.761064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:36.768487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 186/353] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:36.769483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:36.791079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6404d3-a5e0-4810-a80f-a683a244b751 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:36.828469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:36.839505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:36.840398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.840690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.840971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:36.841739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:36.842048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:36.844240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:36.859271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 168/354] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:36.860490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:36.888671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a300d4-7d4f-4fe3-8567-ec01565e88eb None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:36.931438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:36.932095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:36.932375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:36.932695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.004261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9de50-be19-427f-8dd7-9a233fb58600 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.014367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.015864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.050223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.051124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.051411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.051683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.061156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.065790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:37.075068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:37.077254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:37.079887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 169/355] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:37.081543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.081701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.148891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 187/356] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:37.149762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.208898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c34c-70b5-4796-bb1c-d7fc970b8bc6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.250352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.251662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.252260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.252543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.270051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:37.277797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:37.278713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:37.279511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 170/357] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:37.280248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.288512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4211ad-e8ff-4254-8920-b94e312fae19 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.336724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387745a-32d1-4dee-a282-a1eafb0cea9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.337607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387745a-32d1-4dee-a282-a1eafb0cea9a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.338031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387745a-32d1-4dee-a282-a1eafb0cea9a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.338446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387745a-32d1-4dee-a282-a1eafb0cea9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.355235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.363623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.414460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a7ef0-30cd-4aa8-9bfa-ff350dc3ea13 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.432033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387745a-32d1-4dee-a282-a1eafb0cea9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.433945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387745a-32d1-4dee-a282-a1eafb0cea9a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.463978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.465208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.465690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.466246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.467347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:37.467661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.469399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.479083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 171/358] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:37.479713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.568897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 188/359] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:37.570097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa487-7c2a-4726-aea3-ebe016457e13 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.570395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa487-7c2a-4726-aea3-ebe016457e13 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.570661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa487-7c2a-4726-aea3-ebe016457e13 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.572097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 189/360] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:37.573169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fa487-7c2a-4726-aea3-ebe016457e13 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.610458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15003faf-fa4c-4822-835e-201bac831e27 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.637328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.639593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.650212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.651074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.651527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.651955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.660814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.660814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.660814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 172/361] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:37.660814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.698220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fa487-7c2a-4726-aea3-ebe016457e13 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.738928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.739595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.739882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.740367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.741414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:37.741535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.742842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.753639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 190/362] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:37.754701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:37.773631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5788df-9e59-4828-a37b-7e847ed7b459 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.812477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.813955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.814800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.815438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.880573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.885878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27099f2b-24cf-4e20-b6bd-0d93f15a1fed None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:37.893696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.895881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.901716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:37.927477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d581d33-efa1-4ffa-a9f5-9bbbfe8fcf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:37.928597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581d33-efa1-4ffa-a9f5-9bbbfe8fcf68 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.929090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581d33-efa1-4ffa-a9f5-9bbbfe8fcf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.929527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d581d33-efa1-4ffa-a9f5-9bbbfe8fcf68 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.930919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d581d33-efa1-4ffa-a9f5-9bbbfe8fcf68 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:37.932506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d581d33-efa1-4ffa-a9f5-9bbbfe8fcf68 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:37.934432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 191/363] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:37.935790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:37.936236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:37.936699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:37.954366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:37.955837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:38.019105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 173/364] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:38.019969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.035953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 192/365] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:38.037241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.138797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:38.154020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf551e7-7bbf-45f4-a725-8a591e4b294e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.165747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb7230-6bd2-49eb-b6c3-3c22cb0b38a9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.182363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:38.199581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.200430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.200912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.206803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.206803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.206803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.206803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 174/366] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.207110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.217851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.220160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.220917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.221201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] PATH_INFO: `/v3/users/368de85db37a4cc28cba556d3c4b310a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.222691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] RBAC: Authorizing `identity:get_user(user_id=368de85db37a4cc28cba556d3c4b310a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.224753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.227827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 193/367] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/users/368de85db37a4cc28cba556d3c4b310a => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.228602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.332157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d889769-ca59-422d-9f59-f33f4679a0f0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.364574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94dbc8-90af-420b-af87-988ba68d7c4d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.370429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.371289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.371572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.371847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.373094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.374532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.376213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 175/368] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.377017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.410610 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.411471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.411788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.412028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.412328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:38.413612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.415143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.420767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 194/369] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.421625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.492253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:38.500719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33161530-8969-4dcb-9821-7be50ee17ab8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.554758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.555563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.556512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.556512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.569805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:38.574310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d32e-eb82-4b0e-82fe-9abcead455ce None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:38.578441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:38.580105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:38.581187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 176/370] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:38.581870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.619131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.619812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.620096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.620368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.621251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=f97693405a1044c69788e4853614cb54) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:38.621561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.622980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.629260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 195/371] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ef55a3c470c94814b91be114d41243c5 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.629849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.693234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:38.713019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270bf99-15f5-4072-a11d-743d5640c13d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.763545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.764292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.764593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.764973 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.767375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] RBAC: Adding query filter params (role.id=02a07d0fba054284b839937e5b867451, user.id=368de85db37a4cc28cba556d3c4b310a, scope.system=all) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:38.767375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.768972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.771045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23391c92-a5e0-4cf9-8eff-b79eb1ae7b86 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.786740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 177/372] 10.222.0.65 () {56 vars in 1308 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/role_assignments?user.id=368de85db37a4cc28cba556d3c4b310a&scope.system=all&role.id=02a07d0fba054284b839937e5b867451 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.787621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.788858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:38.829603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.829603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.829603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.829603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:38.830016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=03be8df62f0948daa85a617126d106a1) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:38.830016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:38.830142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:38.839974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 196/373] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ef55a3c470c94814b91be114d41243c5 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:38.841286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:38.934519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578c7a-eb4e-4c85-954b-6cfccfdad4db None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.968381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30501cf-8226-4844-a5dc-6087ba7968cf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:38.997461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39826d-03f3-4e72-8cc9-1aed8823cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:38.998353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39826d-03f3-4e72-8cc9-1aed8823cc1e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:38.998633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39826d-03f3-4e72-8cc9-1aed8823cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:38.998909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39826d-03f3-4e72-8cc9-1aed8823cc1e None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.000274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39826d-03f3-4e72-8cc9-1aed8823cc1e None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.002255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39826d-03f3-4e72-8cc9-1aed8823cc1e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.005309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 178/374] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:39.006655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd967f0-2c1c-4823-a8d6-a642e0428328 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.006937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd967f0-2c1c-4823-a8d6-a642e0428328 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.007321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd967f0-2c1c-4823-a8d6-a642e0428328 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.008875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 179/375] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:39.015260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd967f0-2c1c-4823-a8d6-a642e0428328 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.015780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.017048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.017330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.017606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.018379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:39.018691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.021951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a228f75-7f7a-4726-aff9-455ef9ee612c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.038307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 197/376] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:39.039907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.040194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.040470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.041005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.066018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:39.067392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:39.110274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.162356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 198/377] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:39.163503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.165871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd967f0-2c1c-4823-a8d6-a642e0428328 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.222635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.222635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.222915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.223159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.223879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=03be8df62f0948daa85a617126d106a1) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:39.224190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.225658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.231823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 180/378] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:39.234430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.306786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072f897-a9ab-4801-b19d-408ed2cefd3d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.324918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.345966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc1cd6-abc9-4e1d-b0aa-279f2db8e541 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.347022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.347873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.348314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.348765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.387892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.388758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.389311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.389600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.399064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.410275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:39.417854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:39.418818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:39.419600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 181/379] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:39.426330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.450252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.452072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.571271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5e754-c4d0-4d24-ad59-a73605205107 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.608499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.609256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.609578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.609854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.610615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:39.610924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.612924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.621986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 182/380] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:39.625647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.628562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.662222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 199/381] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:39.667420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.740505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73dfe8-cda4-467d-adb9-4216842adea7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.776738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.777856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.778572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.778867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.779142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.780560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.782133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.783961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 183/382] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:39.789624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.841696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50864c4-78b4-4b2a-88f6-09fb77bf2358 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.888983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:39.904134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.910341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.910341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.910341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] PATH_INFO: `/v3/projects/e6923572ff9f4b66867148d1a4dea898` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:39.910341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] RBAC: Authorizing `identity:get_project(project_id=e6923572ff9f4b66867148d1a4dea898)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:39.910341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:39.912002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 200/383] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/projects/e6923572ff9f4b66867148d1a4dea898 => generated 344 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:39.917220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:39.952859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7152dd-3448-407c-b2c3-7fda8f73e25a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:39.998030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:39.998878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:39.999157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:39.999432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:40.001497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:40.003733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:40.005654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 184/384] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:40.012397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:40.123715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce03f96-ce65-4988-98e0-a4e4fc5ab824 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:40.126661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d594fa-ea3d-41c1-8ab6-95eb65fc29f4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:40.164041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103084b-b464-4cf8-8954-728b9589f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:40.165750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103084b-b464-4cf8-8954-728b9589f57d None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:40.166274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103084b-b464-4cf8-8954-728b9589f57d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:40.166780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103084b-b464-4cf8-8954-728b9589f57d None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54/groups/50d8c43e1adc417395ac0aab426a5769/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:40.169002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103084b-b464-4cf8-8954-728b9589f57d None admin] RBAC: Authorizing `identity:create_grant(project_id=f97693405a1044c69788e4853614cb54, group_id=50d8c43e1adc417395ac0aab426a5769, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:40.170933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103084b-b464-4cf8-8954-728b9589f57d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:40.176944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:40.195892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:40.197218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:40.197702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:40.198205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] PATH_INFO: `/v3/groups/98495ebd87ab4ea68c8b7e4d43cf029f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:40.201334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:40.205076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] RBAC: Authorizing `identity:get_group(group_id=98495ebd87ab4ea68c8b7e4d43cf029f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:40.206958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:40.209455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 201/385] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:39 2022] GET /identity/v3/groups/98495ebd87ab4ea68c8b7e4d43cf029f => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:40.216774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:40.289789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 185/386] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jun 16 20:14:40 2022] PUT /identity/v3/projects/f97693405a1044c69788e4853614cb54/groups/50d8c43e1adc417395ac0aab426a5769/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:40.351046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e2134-c091-44bd-a653-437517cb06aa None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:40.400834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:40.405537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:40.406094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:40.406551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:40.407627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] RBAC: Adding query filter params (group.id=98495ebd87ab4ea68c8b7e4d43cf029f, role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=e6923572ff9f4b66867148d1a4dea898) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:40.408137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:40.409768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3b450-7365-48d7-a51a-f365aee80e3a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:40.421704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 202/387] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:40 2022] GET /identity/v3/role_assignments?group.id=98495ebd87ab4ea68c8b7e4d43cf029f&scope.project.id=e6923572ff9f4b66867148d1a4dea898&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:41.454977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af576aea-ee52-400a-a9dc-78fff833d274 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.455503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af576aea-ee52-400a-a9dc-78fff833d274 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.455579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af576aea-ee52-400a-a9dc-78fff833d274 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.457286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 186/388] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:41.467312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2228d-6d35-42d0-99a2-6608a67b3cfd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.467722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2228d-6d35-42d0-99a2-6608a67b3cfd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.467921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2228d-6d35-42d0-99a2-6608a67b3cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.485270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0ac2228d-6d35-42d0-99a2-6608a67b3cfd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:41.486440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0ac2228d-6d35-42d0-99a2-6608a67b3cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:41.547688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:41.557505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 203/389] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:41.591707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af576aea-ee52-400a-a9dc-78fff833d274 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:41.717929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af576aea-ee52-400a-a9dc-78fff833d274 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:41.760103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:41.760962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.761248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.761524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.774752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:41.783644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2f4c-7c3b-47f5-a806-6784a4ecb69e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:41.783974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:41.784917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:41.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:41.786796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2f4c-7c3b-47f5-a806-6784a4ecb69e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.786796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de2f4c-7c3b-47f5-a806-6784a4ecb69e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.787243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 187/390] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:41.787381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 204/391] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:41.791752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:41.796067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1beea-0556-4898-bf62-91a93093f065 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.796358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1beea-0556-4898-bf62-91a93093f065 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.796669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1beea-0556-4898-bf62-91a93093f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.835918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-48d1beea-0556-4898-bf62-91a93093f065 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:41.837705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-48d1beea-0556-4898-bf62-91a93093f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:41.854130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:41.903582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817a3a-b097-47ef-bb59-1ea4c15a26e4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:41.928662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 205/392] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:41.930210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276dddb-897a-4c9b-afd1-8cb02ff63676 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.930824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276dddb-897a-4c9b-afd1-8cb02ff63676 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.931476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276dddb-897a-4c9b-afd1-8cb02ff63676 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.933203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 206/393] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:41.939062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.939586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.939942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.945131 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:41.945783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:41.946248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:41.946581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:41.947515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:41.947879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:41.949344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:41.958828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 188/394] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:41.960561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:41.961787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:41.963892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.055678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 207/395] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:42.055678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.099495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcab16a-afbe-464f-9b2b-46e8df5cfe1f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.115895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.124780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.134583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.135433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.135713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.135984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.137399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.139350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.147277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 189/396] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:41 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.148109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.174473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a462969-26cb-4006-b00f-a87dbb4ca23a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.212403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.213783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.214327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.214789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.225896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:42.235148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:42.236020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:42.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:42.239789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 208/397] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:42.240858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.260527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66cccf-3fe2-4900-98e5-eed6f031f268 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.296488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.297471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.297755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.298289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.308872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:42.317168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:42.318046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 190/398] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:42.324027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.365794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdc610-c7a5-45c5-a5f7-30917c8d1d2a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.384423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.386733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.409391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.410257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.410537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.410807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.412305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.414402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.420755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 209/399] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.421830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.460299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be015a1a-b1f7-4588-b3c9-5d6c3cf29722 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.499139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.500581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.500917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.501193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.501955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:42.502264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.503740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.517066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 191/400] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.517928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.548131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c92fc0-cd9c-4814-ba74-212230b429c7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.590763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.591783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.592263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.592996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.594139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:42.594639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.596233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.610066 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 210/401] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.611481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.627489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed039264-c6d9-4f57-bd54-380ba705b3ee None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.635012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.661786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.665142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.666083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.666365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.666716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54/groups/50d8c43e1adc417395ac0aab426a5769/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.668994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f97693405a1044c69788e4853614cb54, group_id=50d8c43e1adc417395ac0aab426a5769, role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.670420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.719866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2e51-dc68-4413-8d24-afce86aff4ea None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.748026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 192/402] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jun 16 20:14:42 2022] PUT /identity/v3/projects/f97693405a1044c69788e4853614cb54/groups/50d8c43e1adc417395ac0aab426a5769/roles/ef55a3c470c94814b91be114d41243c5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:42.749471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.785159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.788906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.795564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.795564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.795564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.795564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.801146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 211/403] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.815092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.930394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6653c91-4944-4da8-912c-d2d85deee1b7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.940115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f96f04-4314-4192-ae4a-69dfb16410ca None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:42.956070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:42.973772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba515c-1b00-4bb7-b445-3845495f45b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.974612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba515c-1b00-4bb7-b445-3845495f45b5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.974891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba515c-1b00-4bb7-b445-3845495f45b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.975165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba515c-1b00-4bb7-b445-3845495f45b5 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.976342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba515c-1b00-4bb7-b445-3845495f45b5 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.977796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba515c-1b00-4bb7-b445-3845495f45b5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.979795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 193/404] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.985241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a474d-2147-474b-9321-906cb7c0f359 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.985532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a474d-2147-474b-9321-906cb7c0f359 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.985813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a474d-2147-474b-9321-906cb7c0f359 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.987179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 194/405] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:42.987703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ab682-ef25-4e2b-bde8-96426271d2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:42.988283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a474d-2147-474b-9321-906cb7c0f359 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:42.988910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ab682-ef25-4e2b-bde8-96426271d2dd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.989352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ab682-ef25-4e2b-bde8-96426271d2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.989788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ab682-ef25-4e2b-bde8-96426271d2dd None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:42.991168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ab682-ef25-4e2b-bde8-96426271d2dd None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:42.993934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ab682-ef25-4e2b-bde8-96426271d2dd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:42.996172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 212/406] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:42.998651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103ab3-0bb3-4fa6-a757-faa777cafccf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:42.999148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103ab3-0bb3-4fa6-a757-faa777cafccf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:42.999583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6103ab3-0bb3-4fa6-a757-faa777cafccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.016737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b6103ab3-0bb3-4fa6-a757-faa777cafccf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:43.017912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b6103ab3-0bb3-4fa6-a757-faa777cafccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:43.029708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:43.088301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 213/407] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:43.089852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4e824-fc99-48ea-8f2d-5eb5fa5ff040 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.090200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4e824-fc99-48ea-8f2d-5eb5fa5ff040 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.090543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4e824-fc99-48ea-8f2d-5eb5fa5ff040 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.095997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 214/408] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:43.095997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4e824-fc99-48ea-8f2d-5eb5fa5ff040 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.110735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a474d-2147-474b-9321-906cb7c0f359 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.147574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dac08d-644f-41e9-b88d-e2e68cb3f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.148436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac08d-644f-41e9-b88d-e2e68cb3f95b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.148768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac08d-644f-41e9-b88d-e2e68cb3f95b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.149048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dac08d-644f-41e9-b88d-e2e68cb3f95b None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.150269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dac08d-644f-41e9-b88d-e2e68cb3f95b None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:43.151666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dac08d-644f-41e9-b88d-e2e68cb3f95b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:43.153423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 195/409] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:42 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:43.154523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.154807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.155083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.170846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:43.172121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:43.207983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4e824-fc99-48ea-8f2d-5eb5fa5ff040 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.221643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:43.250919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.251806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.252086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.252360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1/groups/50d8c43e1adc417395ac0aab426a5769/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.254877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=03be8df62f0948daa85a617126d106a1, group_id=50d8c43e1adc417395ac0aab426a5769, role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:43.256483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 196/410] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:43.256894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:43.257726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.289165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:43.347649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 215/411] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jun 16 20:14:43 2022] PUT /identity/v3/projects/03be8df62f0948daa85a617126d106a1/groups/50d8c43e1adc417395ac0aab426a5769/roles/ef55a3c470c94814b91be114d41243c5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:43.348810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.356555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4444e2-79ab-4b4b-992f-6e4551f75e55 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.407014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.407881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.408229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.408512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.425446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:43.436237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:43.437328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:43.438693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:43.440787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 197/412] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:43.442064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.517282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3f557-bee1-40cd-87ef-50ae38d70dc1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.571226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.573144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.573782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.574774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:43.575298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1/groups/50d8c43e1adc417395ac0aab426a5769/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.579419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] RBAC: Authorizing `identity:create_grant(project_id=03be8df62f0948daa85a617126d106a1, group_id=50d8c43e1adc417395ac0aab426a5769, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:43.581537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:43.583903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21cdd6a-9042-400b-ad56-53f56e46af04 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.618488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.619277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.619559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.619830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.630710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:43.638353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:43.639258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:43.640213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 198/413] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:43.641003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.685099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 216/414] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jun 16 20:14:43 2022] PUT /identity/v3/projects/03be8df62f0948daa85a617126d106a1/groups/50d8c43e1adc417395ac0aab426a5769/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:43.688026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.762089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:43.830961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73a612-cf96-46c8-a14c-c51a8daf8a57 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.892841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.893761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.894042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.894378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.895735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738db1f-3049-4707-a309-ed3d66969c61 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:43.895856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:43.895856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:43.897102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:43.909697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 199/415] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:43.916260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:43.937189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:43.952356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:43.953082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:43.954139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:43.954139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:43.954389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] RBAC: Adding query filter params (name=member) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:43.954676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:43.956048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:43.971780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 217/416] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:43.977409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:44.079986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cc49b-3666-4192-a805-41fe8000e598 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:44.126615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:44.127394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:44.127678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:44.127956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] PATH_INFO: `/v3/groups/98495ebd87ab4ea68c8b7e4d43cf029f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:44.129312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] RBAC: Authorizing `identity:get_group(group_id=98495ebd87ab4ea68c8b7e4d43cf029f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:44.130766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:44.135076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 200/417] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:43 2022] GET /identity/v3/groups/98495ebd87ab4ea68c8b7e4d43cf029f => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:44.137625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:44.144966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:44.155431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e5d6b-0f85-4170-86d4-81a41d92f509 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:44.226768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:44.227661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:44.228123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:44.228559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:44.277596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:44.310977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8c82c-a0c3-4e2a-b3ff-ae459590b7a9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:44.347176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:44.351594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:44.374295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:44.375390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:44.376454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:44.377130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] PATH_INFO: `/v3/projects/e6923572ff9f4b66867148d1a4dea898` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:44.379789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] RBAC: Authorizing `identity:get_project(project_id=e6923572ff9f4b66867148d1a4dea898)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:44.382301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:44.384237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 201/418] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:44 2022] GET /identity/v3/projects/e6923572ff9f4b66867148d1a4dea898 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:44.389661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:44.507142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:44.513452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 218/419] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:44.521739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:44.529330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a372b5-3281-4517-9489-fdff6d9f60b7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:44.577263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:44.583439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:44.583967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:44.584447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] PATH_INFO: `/v3/projects/e6923572ff9f4b66867148d1a4dea898/groups/98495ebd87ab4ea68c8b7e4d43cf029f/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:44.586757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] RBAC: Authorizing `identity:create_grant(project_id=e6923572ff9f4b66867148d1a4dea898, group_id=98495ebd87ab4ea68c8b7e4d43cf029f, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:44.588396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:44.662284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 202/420] 10.222.0.65 () {58 vars in 1442 bytes} [Thu Jun 16 20:14:44 2022] PUT /identity/v3/projects/e6923572ff9f4b66867148d1a4dea898/groups/98495ebd87ab4ea68c8b7e4d43cf029f/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:14:44.696473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c12611-9e32-4ffb-852d-ffd977fbc5b2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:44.742773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:44.743638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:44.743912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:44.744179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:44.745436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:44.746875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:44.749033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 219/421] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:44 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:44.754686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:44.782982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:44.904374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed89a4-4241-4708-b0c3-8fd05e53fe1a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:44.944392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45719b1-ebcb-4aff-abd3-b3c592d9d826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:44.945181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45719b1-ebcb-4aff-abd3-b3c592d9d826 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:44.945460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45719b1-ebcb-4aff-abd3-b3c592d9d826 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:44.945739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45719b1-ebcb-4aff-abd3-b3c592d9d826 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:44.946929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45719b1-ebcb-4aff-abd3-b3c592d9d826 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:44.948358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45719b1-ebcb-4aff-abd3-b3c592d9d826 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:44.950457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 203/422] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:44 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:44.957729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:45.070392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5a1d-ce3b-478a-9b4c-a3a78a27d963 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:45.070742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5a1d-ce3b-478a-9b4c-a3a78a27d963 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:45.070946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c5a1d-ce3b-478a-9b4c-a3a78a27d963 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:45.072172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:45.072306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 204/423] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:45.077396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:45.078337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:45.078717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:45.105991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:45.107188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:45.144856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34604721-741b-475c-ba1b-44ff7275018f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:45.205833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:45.206409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:45.206695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:45.206974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:45.207812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=f97693405a1044c69788e4853614cb54) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:45.208125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:45.216893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:45.227553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 220/424] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:44 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:45.243475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 205/425] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:45.267867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:45.391857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a709f-e6ed-409d-9fc6-755d9748b4b8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:45.425022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:45.432916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:45.433742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:45.434030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:45.434309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:45.446072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:45.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:45.456888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:45.458371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 221/426] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:45.463666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:45.479141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:45.575779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60a63-ef54-48d7-94b4-66e779570ca4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:45.613283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:45.614019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:45.614243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:45.614522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:45.615295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:45.615605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:45.617019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:45.626858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 206/427] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:45.631984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:45.744237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426951f9-4e9f-4915-92fe-a887476b7e2b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:45.780591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8704915-bf85-459d-816a-e25772cb601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:45.781307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8704915-bf85-459d-816a-e25772cb601d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:45.781593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8704915-bf85-459d-816a-e25772cb601d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:45.781872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8704915-bf85-459d-816a-e25772cb601d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:45.837339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:45.853893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8704915-bf85-459d-816a-e25772cb601d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:45.855421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8704915-bf85-459d-816a-e25772cb601d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:45.959771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 222/428] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:45.965301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.029362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785e3e-5322-449d-968e-01316050cfc6 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.029660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785e3e-5322-449d-968e-01316050cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.029837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1785e3e-5322-449d-968e-01316050cfc6 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.032072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 223/429] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:46.036771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.037058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.037335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.051421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.058059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:46.059260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:46.094846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d18d1-4ed7-4eb9-9150-1d92fd3862ed None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.134585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236c924f-e994-4f6d-a3c3-e2866ed190d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.135880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c924f-e994-4f6d-a3c3-e2866ed190d7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.136366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c924f-e994-4f6d-a3c3-e2866ed190d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.136874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236c924f-e994-4f6d-a3c3-e2866ed190d7 None admin] PATH_INFO: `/v3/projects/f97693405a1044c69788e4853614cb54` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.138317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c924f-e994-4f6d-a3c3-e2866ed190d7 None admin] RBAC: Authorizing `identity:get_project(project_id=f97693405a1044c69788e4853614cb54)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:46.138585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 224/430] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:46.140786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236c924f-e994-4f6d-a3c3-e2866ed190d7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:46.142984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 207/431] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:45 2022] GET /identity/v3/projects/f97693405a1044c69788e4853614cb54 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:46.148107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.154965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef560f4-924c-46d7-829f-93c548cdeec0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.155535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef560f4-924c-46d7-829f-93c548cdeec0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.156110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef560f4-924c-46d7-829f-93c548cdeec0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.157934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 208/432] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:46.163920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.164203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.164483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.166995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.186553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:46.189268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:46.262482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 209/433] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:14:46.263206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.263792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada1769-39a4-42c2-b3b1-bcbb7706ba63 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.314019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.315156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.315440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.315716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.317518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:46.319145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:46.321483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 225/434] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:46.325444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.346781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.380857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349255a-8f9e-4d6e-9483-bb7c5ac57bec None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.415842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.416212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.416672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.417290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.417583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.428045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:46.434529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d4701-6b5a-45ba-a955-70cb894b5c63 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:46.436174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:46.437220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 210/435] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:46.438286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.475790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.476695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.476983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.477264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.487562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:46.495306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:46.496189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 226/436] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:46.497754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.549989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab69143-cfed-473f-918a-18ff16756acc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.581725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.590442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.592502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.592502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.592502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.593649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=f97693405a1044c69788e4853614cb54) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:46.593966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:46.596075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:46.612646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 211/437] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=f97693405a1044c69788e4853614cb54&role.id=ef55a3c470c94814b91be114d41243c5 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:46.612646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.614776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e29e2-9bea-4c2a-be7c-02b867b45708 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.666455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.667247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.667538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.667816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.668593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:46.668984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:46.670453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:46.683023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 227/438] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:46.690348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.697551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.758069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c0721-ee95-4081-b882-464aa7fb739e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.803797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.804467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.804803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.805084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.805849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:46.806162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:46.807539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:46.819649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 212/439] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:46.825141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:46.829251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625abb-3713-46f7-bdb0-74f2ae5fb609 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.873002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:46.873588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:46.873900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:46.874786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:46.904349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:46.960869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:46.961875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df449467-0feb-4d2e-b5b8-f525be57d5f8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:46.962330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:46.972229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.007578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867fe12-1a2b-458a-8c66-9e1020ac0c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.008237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fe12-1a2b-458a-8c66-9e1020ac0c3f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.008521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fe12-1a2b-458a-8c66-9e1020ac0c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.008824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867fe12-1a2b-458a-8c66-9e1020ac0c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.100592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867fe12-1a2b-458a-8c66-9e1020ac0c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.102130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867fe12-1a2b-458a-8c66-9e1020ac0c3f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.104299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 228/440] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:47.110824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.162618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.209659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d35975-beac-4e47-9542-21c51625ecd3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.211273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 213/441] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:14:47.211876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.214032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98a3b6-1edb-43be-95f0-4d68e11ae9be None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.214317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98a3b6-1edb-43be-95f0-4d68e11ae9be None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.214591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98a3b6-1edb-43be-95f0-4d68e11ae9be None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.215966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 214/442] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:47.216764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98a3b6-1edb-43be-95f0-4d68e11ae9be None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.244000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcceca-2eb7-4d12-8948-78a67faabec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.244878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcceca-2eb7-4d12-8948-78a67faabec3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.245162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcceca-2eb7-4d12-8948-78a67faabec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.245431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcceca-2eb7-4d12-8948-78a67faabec3 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.246593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcceca-2eb7-4d12-8948-78a67faabec3 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.248015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcceca-2eb7-4d12-8948-78a67faabec3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.249733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 229/443] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:14:47.250834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.251113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.251397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.267052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:47.268210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:47.315384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98a3b6-1edb-43be-95f0-4d68e11ae9be None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.333993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 230/444] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:47.334811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.354749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.355601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.355883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.356240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] PATH_INFO: `/v3/projects/03be8df62f0948daa85a617126d106a1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.357460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] RBAC: Authorizing `identity:get_project(project_id=03be8df62f0948daa85a617126d106a1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.358953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.360656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 215/445] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/projects/03be8df62f0948daa85a617126d106a1 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:47.361404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.384270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.432580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d5ce4-72b4-4ef4-9167-0c9795d70928 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.434037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.457788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89327f9-9dc2-43f6-9052-ea73e1741df7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.466105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.466962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.467242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.467519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.469253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.470681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.472299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 231/446] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:47.473092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.491059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.491836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.492114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.492379 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.502410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:47.509883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:47.510922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:47.511720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 216/447] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:47.512373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.572581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2a328-0c20-4d5e-993a-73ac153fecf3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.591852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.605272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.606120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.606439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.606775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] PATH_INFO: `/v3/groups/50d8c43e1adc417395ac0aab426a5769` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.607929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] RBAC: Authorizing `identity:get_group(group_id=50d8c43e1adc417395ac0aab426a5769)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.609369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3114b5-9413-49d5-922e-94bf1db46f91 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.609474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.611003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 232/448] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/groups/50d8c43e1adc417395ac0aab426a5769 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:47.611752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.645274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.645923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.646207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.646482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.647316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=03be8df62f0948daa85a617126d106a1) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:47.647629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.649109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.650440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.654943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 217/449] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ef55a3c470c94814b91be114d41243c5 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:47.655714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.721015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82653c75-c75f-4d26-8a27-9c2d15313b5f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.760588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.761302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.761587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.761860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.762623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:47.762938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.764340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.767831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab228a4a-c9c2-470e-a16c-c0c257743385 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.778975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 233/450] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:47.780142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:47.809499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.810156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.810444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.810726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:47.811563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] RBAC: Adding query filter params (group.id=50d8c43e1adc417395ac0aab426a5769, role.id=ebb073838eae41259f93a5ed2bc31346, scope.project.id=03be8df62f0948daa85a617126d106a1) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:47.812419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:47.813909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:47.820783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 218/451] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/role_assignments?group.id=50d8c43e1adc417395ac0aab426a5769&scope.project.id=03be8df62f0948daa85a617126d106a1&role.id=ebb073838eae41259f93a5ed2bc31346 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:47.897508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:47.900499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900face-8570-4a47-8b0b-f2f0a8dfc594 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:47.936581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:47.937830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:47.938110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:47.938381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:48.008827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:48.010216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:48.104926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:48.109114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 234/452] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:14:48.114757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:48.127913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:48.216559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17db971-a4f4-43b3-8883-03835ef24591 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:48.250537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:48.251400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:48.251686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:48.251963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] PATH_INFO: `/v3/projects/e6923572ff9f4b66867148d1a4dea898` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:48.253191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] RBAC: Authorizing `identity:get_project(project_id=e6923572ff9f4b66867148d1a4dea898)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:48.254688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:48.256601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 219/453] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:14:48 2022] GET /identity/v3/projects/e6923572ff9f4b66867148d1a4dea898 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:48.261917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:48.358297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe437f02-7917-4046-aa5f-7e5c9fb4f4cf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:48.390483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac7eba-6ac0-4bda-9c9c-e6d99824e127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:48.398242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7eba-6ac0-4bda-9c9c-e6d99824e127 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:48.398242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7eba-6ac0-4bda-9c9c-e6d99824e127 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:48.398242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac7eba-6ac0-4bda-9c9c-e6d99824e127 None admin] PATH_INFO: `/v3/groups/98495ebd87ab4ea68c8b7e4d43cf029f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:48.398242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac7eba-6ac0-4bda-9c9c-e6d99824e127 None admin] RBAC: Authorizing `identity:get_group(group_id=98495ebd87ab4ea68c8b7e4d43cf029f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:48.398242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac7eba-6ac0-4bda-9c9c-e6d99824e127 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:48.398242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 235/454] 10.222.0.65 () {56 vars in 1180 bytes} [Thu Jun 16 20:14:48 2022] GET /identity/v3/groups/98495ebd87ab4ea68c8b7e4d43cf029f => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:48.402007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:48.478538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:48.499575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9141c-0b9e-4971-8dcc-afd6f38fb015 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:48.532053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:48.532650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:48.532942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:48.533220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:48.534053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] RBAC: Adding query filter params (group.id=98495ebd87ab4ea68c8b7e4d43cf029f, role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=e6923572ff9f4b66867148d1a4dea898) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:48.534368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:48.535777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c017fb9f-5fed-4c8a-bb93-5f28ded73a5d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:48.541652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 220/455] 10.222.0.65 () {56 vars in 1376 bytes} [Thu Jun 16 20:14:48 2022] GET /identity/v3/role_assignments?group.id=98495ebd87ab4ea68c8b7e4d43cf029f&scope.project.id=e6923572ff9f4b66867148d1a4dea898&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:51.136538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c916-5bc8-49b9-b7dc-f488703eb7e9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.137124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c916-5bc8-49b9-b7dc-f488703eb7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.137124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4c916-5bc8-49b9-b7dc-f488703eb7e9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.138754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 236/456] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:51.144336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.145160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.145655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.169531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:51.171079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:51.258315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 221/457] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:51.294824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c916-5bc8-49b9-b7dc-f488703eb7e9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:51.391515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:51.437424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4c916-5bc8-49b9-b7dc-f488703eb7e9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:51.483641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:51.484453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.484765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.485039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.506725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:51.508174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-b3d99d92-7a52-414c-91ba-dbb2117dfb94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:51.532196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:51.533142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:51.533971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:51.533971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:51.533971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:51.533971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:51.533971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 237/458] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:51.545632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:51.631980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdbf0-91d4-4e3a-988f-cdd24004cdb9 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.632284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdbf0-91d4-4e3a-988f-cdd24004cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.632528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdbf0-91d4-4e3a-988f-cdd24004cdb9 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.633906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 238/459] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:14:51.642288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836004b0-13f5-4ad7-b0fc-b2b8e9685d3a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.642512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836004b0-13f5-4ad7-b0fc-b2b8e9685d3a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.642789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836004b0-13f5-4ad7-b0fc-b2b8e9685d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.647575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:51.681376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8df845-6c5a-4882-95a2-81814be11ccf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:51.681694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-836004b0-13f5-4ad7-b0fc-b2b8e9685d3a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:51.682960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-836004b0-13f5-4ad7-b0fc-b2b8e9685d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:51.763016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:51.764137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.764707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.764987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.765731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:51.766041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:51.767867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eae8f-5937-4b77-b397-4407155bceb3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:51.784481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 222/460] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:51.786553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9032-3094-41c3-84d2-6c1a770a89d5 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.786848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9032-3094-41c3-84d2-6c1a770a89d5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.787124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac9032-3094-41c3-84d2-6c1a770a89d5 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.792629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 223/461] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:51.792629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9032-3094-41c3-84d2-6c1a770a89d5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:51.799896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 239/462] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:51.801714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.802157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.802432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.834649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:51.835929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:51.888501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:51.916747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac9032-3094-41c3-84d2-6c1a770a89d5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:51.916977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 240/463] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:51.916977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:51.959555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:51.966443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:51.971885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:51.971885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:51.971885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:51.971885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:51.971885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.037538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b80a1-01cf-4475-8c40-8842f045b541 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.047276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 224/464] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:51 2022] POST /identity/v3/users => generated 246 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:52.048080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.077567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.078774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.079060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.079448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.094412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.096813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-65a2562a-b665-4bdd-af22-bc372c1d2f6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:52.122779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:52.123747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:52.125016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:52.125016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:52.125016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:52.125016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:52.125016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 241/465] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:52.126039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0760b5b-2132-4cf3-9eb0-4a89a8577951 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.126327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0760b5b-2132-4cf3-9eb0-4a89a8577951 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.126604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0760b5b-2132-4cf3-9eb0-4a89a8577951 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.128348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 242/466] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:52.133999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.134407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.134783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.158756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:52.160170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:52.190456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a8444-5de9-41cd-9cc8-70eaec9b96ff None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.199566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:52.241413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.242234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.242708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.242811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.257067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.258528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.260472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 243/467] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:52.261139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:52.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:52.292166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:52.293036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:52.293036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:52.293036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:52.293036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:52.294926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 225/468] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:52.296395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.352994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:52.397000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943ffa0-677a-4331-9c5d-6f038afc891e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.429742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90a4db-90c0-4ab6-baf8-14c43dab6ea9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.435798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.436569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.436902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.437175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.437898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:52.438199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.443385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.451557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 244/469] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:52.452915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.477981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:52.481661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.483389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.483846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.484424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.496426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.497910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-5aef9c9e-ca14-4189-8fd4-edbbe984f56e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:52.518858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:52.519742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:52.520589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:52.520589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:52.520589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:52.520589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:52.524761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 226/470] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:52.526428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54311e-fda3-4b68-83af-e0bf50eb6785 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.526786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54311e-fda3-4b68-83af-e0bf50eb6785 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.527122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54311e-fda3-4b68-83af-e0bf50eb6785 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.528689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 227/471] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:52.529184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54311e-fda3-4b68-83af-e0bf50eb6785 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.565879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdae17-4264-4d80-97c2-5c8d869033bf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.600666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.601585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.601868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.602144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.602861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:52.603169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.604546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.616195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 245/472] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:52.624072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.641323 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:52.652658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54311e-fda3-4b68-83af-e0bf50eb6785 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.686572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724f6cf-d9d3-4535-b232-cebbaf5ed5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.687235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724f6cf-d9d3-4535-b232-cebbaf5ed5ae None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.687531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724f6cf-d9d3-4535-b232-cebbaf5ed5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.687798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724f6cf-d9d3-4535-b232-cebbaf5ed5ae None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.688507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724f6cf-d9d3-4535-b232-cebbaf5ed5ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.689985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724f6cf-d9d3-4535-b232-cebbaf5ed5ae None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.715418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:52.732826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f4c00-d2b2-4968-a51f-487f5804499a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.762006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 228/473] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:52 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:52.763254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.763536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.763808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.777630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.778565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.779030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.779545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.781253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:52.781733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.783297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.793076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:52.794664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:52.797952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 246/474] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:52.799143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.893057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 229/475] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:52.894282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:52.935468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8b1bf-8a08-4e6b-b50a-23ce35cb65df None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:52.985414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:52.986051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:52.986335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:52.986616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:52.987335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:52.988814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:52.996955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:53.024109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aa8a9-d714-4864-bad1-93868a2d6c39 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:53.059228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:53.059946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:53.060226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:53.060500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:53.061798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:53.063420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:53.093536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:53.104640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 247/476] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:52 2022] POST /identity/v3/users => generated 248 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:53.104640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:53.138956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 230/477] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:52 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:53.251719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a70067-a809-4305-94fd-fbe0f28e66c0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:53.301180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:53.301877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:53.302155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:53.302442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:53.303189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:53.305533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:53.349799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.sql.core [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 20:14:53.349799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 20:14:53.349799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [parameters: {'id': '639120679f24489ebeb98c6037e30b88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 20:14:53.349799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result.read() Jun 16 20:14:53.367001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:14:53.367952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application yield resource Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise self.value Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application session.commit() Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 20:14:53.368990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.session.flush() Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application compat.raise_( Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 20:14:53.369846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:14:53.370733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result.read() Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:14:53.371557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [parameters: {'id': '639120679f24489ebeb98c6037e30b88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:53.372334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 20:14:53.377531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:53.379560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 248/478] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jun 16 20:14:53 2022] POST /identity/v3/roles => generated 144 bytes in 268 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:53.389211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:53.523741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c077d2-40f4-406e-87e1-443759cb5845 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:53.571300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376d4d4-181a-4267-9223-205b0fec0aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:53.572116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d4d4-181a-4267-9223-205b0fec0aeb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:53.572392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d4d4-181a-4267-9223-205b0fec0aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:53.572711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376d4d4-181a-4267-9223-205b0fec0aeb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:53.580936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:53.585724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376d4d4-181a-4267-9223-205b0fec0aeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0376d4d4-181a-4267-9223-205b0fec0aeb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:53.594703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:53.601033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:53.601848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 231/479] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:14:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:53.602491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:53.692112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:53.739791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158de71-4a00-4b54-be44-38691f4ff8f5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:53.784535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:53.785197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:53.785482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:53.785759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:53.786515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:53.786823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:53.788179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356815e-b062-4aa4-9c6e-5d09d4d21150 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:53.797555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 249/480] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:54.476651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82b93-52df-43c0-9be0-5323eff70d5e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:54.477202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82b93-52df-43c0-9be0-5323eff70d5e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:54.477280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82b93-52df-43c0-9be0-5323eff70d5e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:54.478917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 232/481] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:54.489495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:54.490051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:54.490051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:54.563685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:54.564905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:54.649314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 250/482] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:54.680560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82b93-52df-43c0-9be0-5323eff70d5e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:54.834357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82b93-52df-43c0-9be0-5323eff70d5e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:54.878659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:54.879449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:54.879727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:54.879999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:54.894347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:54.901951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:54.902898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:54.903706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 233/483] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:54.910201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:54.995842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:55.059366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d0c8e-695c-4b6a-accb-507e20a612e3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:55.100105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:55.100746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.101032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.101310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.102063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:55.102370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:55.103784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:55.112959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 251/484] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:55.118014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:55.215224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:55.284303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e8f32-2545-4e2a-9f2e-41a9c46e2d8b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:55.328089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:55.328897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.329176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.329448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.349345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:55.350897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3727ea49-b727-4b4f-92da-d6d32baf4ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:55.373956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:55.376045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:55.378165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:55.378165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:55.378165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:55.378165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:55.379574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 234/485] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:55.380863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:55.566791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf88bd2-fb91-4c0e-8ca9-b0266f3aaae3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:55.569820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aafac-f3d4-42e5-983b-b6820ef1a8e9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.570256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aafac-f3d4-42e5-983b-b6820ef1a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.570458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2aafac-f3d4-42e5-983b-b6820ef1a8e9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.575628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 235/486] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:55.578349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351bf7c-6642-432a-94c0-b11bb410d089 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.578631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351bf7c-6642-432a-94c0-b11bb410d089 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.578910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351bf7c-6642-432a-94c0-b11bb410d089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.586021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:55.616223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1351bf7c-6642-432a-94c0-b11bb410d089 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:55.617377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1351bf7c-6642-432a-94c0-b11bb410d089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:55.622696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:55.623440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.623724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.623997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.624753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:55.625134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:55.626517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79c4b2-8504-410f-9b5a-f63e8b1bc459 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:55.644707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 252/487] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:55.646251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58bb8-875f-4595-ae07-13f4bd3a46de None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.646545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58bb8-875f-4595-ae07-13f4bd3a46de None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.646962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58bb8-875f-4595-ae07-13f4bd3a46de None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.648650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 253/488] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:55.649339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58bb8-875f-4595-ae07-13f4bd3a46de None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:55.699316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 236/489] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:55.700825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.701118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.701941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.730510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:55.731828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:55.761950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:55.781935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58bb8-875f-4595-ae07-13f4bd3a46de None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:55.808991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 237/490] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:55.810186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:55.826407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:55.827754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.828035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.832974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:55.843800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:55.845279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:14:55.860959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:55.861858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:55.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 254/491] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:14:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:55.863319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:55.904563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:55.938203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df84f5c-9c70-4422-9a32-848688fa9959 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:55.976044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042dbe-8702-496b-8f78-1e5b9765ade6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:55.985159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:55.985973 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:55.986258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:55.986537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.005169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:56.013775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:56.015209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:56.016001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:56.022160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 238/492] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:14:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:56.022160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.025372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94095a2e-b56a-4048-9c31-81e95fd7863a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.026178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095a2e-b56a-4048-9c31-81e95fd7863a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.026459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095a2e-b56a-4048-9c31-81e95fd7863a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.026733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095a2e-b56a-4048-9c31-81e95fd7863a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.038159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94095a2e-b56a-4048-9c31-81e95fd7863a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-94095a2e-b56a-4048-9c31-81e95fd7863a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:56.047011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:56.047924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:56.048754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:56.049375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.050742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 255/493] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:14:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:56.051836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591feb5d-dfa5-4892-897d-da9abda6acf3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.052125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591feb5d-dfa5-4892-897d-da9abda6acf3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.052404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591feb5d-dfa5-4892-897d-da9abda6acf3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.053829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 256/494] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:56.054382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591feb5d-dfa5-4892-897d-da9abda6acf3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.125454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700d613-93b3-4b85-980f-78383af49c23 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.160887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.161559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.162160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.162439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.163280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:56.163593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.165054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.166141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.173582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591feb5d-dfa5-4892-897d-da9abda6acf3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.207825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 239/495] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:56.207825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.214403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.215431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.215716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.215991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.217893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:56.218205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.219733 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3c5df-47a3-435a-bd6c-0d1481a130c4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.234894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 257/496] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:56.234894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.234894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.234894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.250206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:56.251692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:56.294811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.312201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3c310-8661-41ef-ae41-8380e745535b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.323933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 258/497] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:56.325370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.354681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.355508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.355889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.356288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.357141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:56.357448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.358841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.371233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 240/498] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:56.371233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.424530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.436581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b212f-14ed-4061-9655-b5e081df1b0b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.477326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f210344-a2ff-437d-95ae-48fc5ef45003 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.480921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.481128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.481463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.481889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.515546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.516322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.516599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.516892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.527575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.530076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.537197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:56.550490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:56.562515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:56.563507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:56.563507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:56.563507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:56.563507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:56.563507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 241/499] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:56.563507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.563835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.563835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.642910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.655667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 259/500] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:56.656390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.666359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b517b8-c04f-47b9-b2d3-70d7bd732592 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.699985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb77de-1df2-4c4a-88d7-04ef2718a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.700727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb77de-1df2-4c4a-88d7-04ef2718a502 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.701010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb77de-1df2-4c4a-88d7-04ef2718a502 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.701310 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb77de-1df2-4c4a-88d7-04ef2718a502 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.711449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb77de-1df2-4c4a-88d7-04ef2718a502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f0eb77de-1df2-4c4a-88d7-04ef2718a502 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:14:56.719532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:56.720506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:56.721342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 242/501] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:56.722136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0946-876c-43b6-a916-b8dc3e50f01c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.722136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0946-876c-43b6-a916-b8dc3e50f01c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.722413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0946-876c-43b6-a916-b8dc3e50f01c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.723648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 243/502] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:14:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:14:56.724335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de0946-876c-43b6-a916-b8dc3e50f01c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.757868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f0514-c567-4e7f-90f4-5c1d2fae7f29 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.781996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.791648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.792425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.792735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.793011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.803866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.805404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.822353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de0946-876c-43b6-a916-b8dc3e50f01c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:56.822778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:56.823580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:56.824655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:56.824655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:56.824655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:56.824655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:56.824655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 260/503] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:56.824914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.857202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.858383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.858665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.858936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.859654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:56.859960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.861364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9e326-ddad-4077-a32a-f761e3d4993f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.867869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:56.872725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 244/504] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:56.873926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.874216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.874492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.890393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:14:56.891635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:14:56.925118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b53470-9e5b-4cd5-a5bf-20a331fc3b73 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:56.955955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 245/505] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:14:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:14:56.956734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:56.956837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:56.957614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:56.957900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:56.958174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:56.971357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:56.972835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:56.989764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:56.990627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:56.991633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:56.991633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:56.991633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:56.991633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:56.991633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 261/506] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:56.992047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.008117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.058471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97dac9b-9c72-43bd-827d-cfdb413550dc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.080274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.088514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc6686-955f-46f1-92e0-6841e77e17a4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.091067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.091729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.092547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.092852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.093598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.093905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.095276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.103208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 246/507] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.103767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.122573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.123375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.123769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.124142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.125005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.125416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.126867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.137767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 262/508] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.138534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.200877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15b096-f1eb-4081-8d2a-cab60b8327e5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.211555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.234602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.235396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.235678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.235951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.237750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98320979-08d2-4c16-96db-6b1215eccb52 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.244090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.245564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:14:57.260580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:57.261482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 247/509] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:57.263037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.273264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.274050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.274338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.274615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.285673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.287113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:57.303931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:57.304806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:57.305638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:57.305638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:57.305638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:57.305638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:57.305638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 263/510] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:57.305894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.313444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.364252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d18c23-b2c9-4bee-a91e-7479e8bef90f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.397612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.399341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.399658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.406156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.406156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.406156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.406156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.409207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd73689-3b78-4862-9584-8bdcf498f8e6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.413762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 248/511] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.414548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.443503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.444282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.444560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.444889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.445065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.455677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.457164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:57.474070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:57.474891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:57.475718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:57.475718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:57.475718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:57.475718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:57.475718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 264/512] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:57.475992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.518866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2663-1348-466e-b1c2-dad5531a795d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.531199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.556458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.557279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.557562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.557830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.565445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.566883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.575701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7736df-7c36-4d93-b7fc-fcc3f5a85821 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:14:57.581403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:57.582274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:57.583183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 249/513] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:57.583762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.613419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.614075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.614354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.614632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.615464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.615774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.617229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.653476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 265/514] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.654315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.673853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.682948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9abe4-f590-4a65-8fea-a9fa9b548c63 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.716221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.716945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.717237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.717505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.718228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.718535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.719892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.730705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 250/515] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.731425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.754887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9508ad-1441-4d40-91b0-b990bed52b51 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.768353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.787139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.787916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.788200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.788475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.795509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.797239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:14:57.812443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:57.813501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:57.814562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 266/516] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:57.816087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.830924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d00940-7fba-44e8-a429-1b3800efbfea None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.864332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.865017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.865298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.865568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.866285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.866586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.867954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.880190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 251/517] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.881220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.892710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:57.917833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd010e7-1c7f-42e5-bf76-e71cfb71dc6e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:57.950246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:57.951020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:57.951909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:57.952287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:57.953253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:57.953573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:57.955007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:57.971966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 267/518] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:57.972761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:57.979928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263a354-d55b-4ad5-b592-a1c9c7a21747 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.001322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.014198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.014838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.015121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.015398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.067640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a142ad1-1597-4c23-b97a-e4985a81baf1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.081309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.082772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.093333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.101867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.102598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.102907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.103212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.103900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.105322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.178384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 252/519] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:58.179207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.200644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 268/520] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:14:57 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:14:58.200644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.285074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.293715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d779f-5450-4023-b7c2-3943944e8770 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.297990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d5fce-bff6-4edc-a33c-fb77291f12d0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.305405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.332299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.333212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.333578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.333955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.334859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:58.335273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.336244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.336976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.337075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.337259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.343109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.345181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.346691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.356533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 253/521] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:58.357695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:14:58.361505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:58.366488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 269/522] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:58.367673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.476551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3346afe-2455-42cf-8412-697802c6c936 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.476945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f21cb0-d53c-4bb1-a1be-295f71d7638f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.513520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.513759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.514364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.514480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.514644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.514893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.514983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.515296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.525974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.527516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.535767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:58.546701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:58.548375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:58.549326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:58.549326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:58.549326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:58.549326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:58.549326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 270/523] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:58.549326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.568518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.597663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.599122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.663900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea542c-e3e5-4ae8-8862-ed29b4ccdacd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.704216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.705036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.705321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.705598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.706430 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=7be4c89082ac47d786cf7e1821ed01b3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:58.706742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.711327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 254/524] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:58.711327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.711882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.716681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 271/525] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/role_assignments?user.id=7be4c89082ac47d786cf7e1821ed01b3&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:58.720788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.813218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.813565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:58.856180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98612177-213d-4ac9-8fee-be25813fe775 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.859065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cecc2-2399-4b78-b7e6-985ca97131a2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:58.898081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.898674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.898962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.899241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.899969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:58.900280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.901872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.905639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:58.906540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:58.907130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:58.907603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:58.908659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:58.909663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:58.911305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:58.920463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 272/526] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:58.921408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:58.934412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 255/527] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:58.935605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.038514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f100ab-c4e5-4c22-b5ae-0f50e030fd3b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.054211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c974b52-fc20-489e-99a1-84a81505a04c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.071359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:59.079396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.080418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.080732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.081014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.088416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.088969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:59.089906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.100211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.101285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.101844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.102560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:14:59.109246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:59.110090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:14:59.110924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 256/528] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:59.111384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.120540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.123341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:59.147435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:59.148360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:59.149257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:59.149257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:59.149257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:59.149257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:59.152955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 273/529] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:59.153975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.238568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e563bdd-49f4-4a35-b591-6f9478dce033 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.267451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402cc90-9eef-4cf7-ae9b-881e52de444f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.279459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.280563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.280953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.281299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.304558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.305699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.306212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.306678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.307686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:59.308313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.309860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.334842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 274/530] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:59.334842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.360159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:59.371783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:59.379048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.381477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.454708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd25a6-1b8a-46ef-ad2e-741149b6b54e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.499053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.499593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 257/531] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:14:59.499883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.500235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.500513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.501288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:59.501533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.501643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.503010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.522488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 275/532] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:59.522488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.612534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:59.626590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf24cb-6f0a-4383-a189-1e9407c2d815 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.639819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:14:59.646628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae215764-af9f-4367-8883-8ae0efdcfd1b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.669188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.670402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.670683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.670957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.672045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=37174d8d343d4989a8c41b4d43246c0e) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:14:59.672355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.674648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.684773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 258/533] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/role_assignments?user.id=37174d8d343d4989a8c41b4d43246c0e&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:14:59.685966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.695706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.700972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.701607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.702113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.721882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.725403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:14:59.766600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:14:59.767549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:14:59.768382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:14:59.768382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:14:59.768382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:14:59.768382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:14:59.775084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 276/534] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:14:59.781138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:14:59.903991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb8f0bf-a60d-44db-a585-0f619cd4c9f7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.956721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff311c-c62a-4447-b9fc-9da329ef5d4f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:14:59.973250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:14:59.974051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:14:59.974333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:14:59.974607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:14:59.991773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:14:59.993946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.006632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.007291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.007568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.007839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.008561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:00.008898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:00.010321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:00.027112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:00.028071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:00.028994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:00.029944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 259/535] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:00.035475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.036585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 277/536] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:00.041852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.068963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:00.069150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:00.156565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247544b-f19f-4406-a9c3-b6056e36a2ea None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:00.190908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.191715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.192065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.192439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.193319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:00.193689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:00.195176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.207857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 260/537] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:00.213588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.257267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126793d-e925-4b80-808e-cbbdf02604f3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:00.292382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:00.314435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe8ec5-d998-4cf1-9b59-d9dfc414a39b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:00.345911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.346836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.347118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.347391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.349802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.350459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.350793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.351078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.351917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=21161c14bb024771be73ce9248ef515c) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:00.352230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:00.353694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.360125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 261/538] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/role_assignments?user.id=21161c14bb024771be73ce9248ef515c&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:00.362867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:00.364350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-9bd568ab-2562-4506-9ad8-aa144678b1b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:00.394086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:00.403124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:00.404227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 278/539] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:00.408984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.530455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b994f-7daa-4c53-88a2-1f56d55a0cde None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.530789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b994f-7daa-4c53-88a2-1f56d55a0cde None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.531017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b994f-7daa-4c53-88a2-1f56d55a0cde None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.536792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 279/540] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:00.538554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.539059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.539578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.568910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:00.571010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:00.601201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe316-507e-40e0-ab97-8be3d42d73e8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:00.640937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.641771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.642159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.642535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.643439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:00.643852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:00.645433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.648280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:00.649066 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:00.655092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 280/541] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 20:15:00.670334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 262/542] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:00.670488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.682763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.822271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e811e0d-4bce-4ff9-9e84-592da8ba657f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:00.831360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a01b26-9be3-4efe-8cc2-1b30235eec50 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:00.865726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.866393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.866679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.866959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.867805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=046675b504304fb6991ff823ef931802) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:00.868121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:00.869594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:00.875316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:00.876113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:00.876442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:00.876744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:00.887561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 281/543] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/role_assignments?user.id=046675b504304fb6991ff823ef931802&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:00.891609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:00.899708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:00.900697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:00.901499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 263/544] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:00.907411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:00.989973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:01.057318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83832a11-517b-471b-bc74-9c672a9f2e3e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.106627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:01.107893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.108245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.108535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.109410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:01.109732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:01.111172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce78d25-832c-4839-8393-25db1767c8b1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:01.127208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 282/545] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:01.132830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:01.186825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906adc2e-a50f-419c-83a3-02015739597b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.187145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906adc2e-a50f-419c-83a3-02015739597b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.187392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906adc2e-a50f-419c-83a3-02015739597b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.189755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 283/546] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:01.195950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.196399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.196717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.207818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:01.218590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:01.219844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:01.258944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c2334-c8fc-47bd-bdca-7bdf70d8fc94 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.297252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:01.298033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.298312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.298682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.310608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:01.312476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:01.331618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:01.332566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:01.334654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:01.334654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:01.334654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:01.334654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:01.334654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 264/547] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:01.344390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:01.373084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 284/548] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:01.409852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:01.457222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dbd43-5675-477f-9859-0d6587e103b7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.472505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:01.522947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:01.523520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.523801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.524095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.524811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:01.525203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:01.526472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:01.527632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:01.560476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 265/549] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:01.561387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:01.630495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d8e3f-8f36-4c5f-b793-3e792c12b576 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.669733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b6728-5c7d-4143-82a7-adfd211d6348 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.709544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:01.709969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:01.710360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.710639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.710804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.710897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.711073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.711325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.720083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:01.721565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:01.737082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:01.738033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:01.738942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 266/550] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:01.744156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:01.749561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:01.765131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:01.766167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:01.766990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 285/551] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:01.777657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:01.781392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:01.886234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99233c1-7e9d-4058-b769-a58907c39748 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.947049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:01.950280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:01.950589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:01.951395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:01.953938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:01.954259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:01.955712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:01.973837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b276ef-b7a0-40af-a6e8-07fd1fc5ea52 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:01.993159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 267/552] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:01.999014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.001935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.043702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.044375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.044715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.045038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.045797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:02.046102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.048465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.067763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 286/553] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:02.073112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.152843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.184438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f2da3-403f-4628-a356-a8631f5af1f2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.207135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3a210-8909-454c-9a97-8db556fe91d4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.242088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.242872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.243211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.243484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.246511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782da34-877b-4621-863b-2e82460e111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.247163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782da34-877b-4621-863b-2e82460e111f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.247550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782da34-877b-4621-863b-2e82460e111f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.248296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782da34-877b-4621-863b-2e82460e111f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.254891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.256331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-23afde42-17ce-4066-9f97-70cade65c751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:02.274593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:02.276756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 287/554] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f42b7-9fef-4626-862d-53edfa068159 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f42b7-9fef-4626-862d-53edfa068159 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.278842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f42b7-9fef-4626-862d-53edfa068159 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.280999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 288/555] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:02.285839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.286126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.286403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.308956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:02.311723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:02.323751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782da34-877b-4621-863b-2e82460e111f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.325270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782da34-877b-4621-863b-2e82460e111f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.345099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.413513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 289/556] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:02.414489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.425498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.442589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 268/557] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 20:15:02.449812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782da34-877b-4621-863b-2e82460e111f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.564962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f73bb-e9b1-4a97-8bd1-b642af7f2c52 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.588592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782da34-877b-4621-863b-2e82460e111f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.600087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.600775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.601053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.601328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.602050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:02.602616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.603704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.619654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 290/558] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:02.620599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.637046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.639096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.639867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.640351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.640967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.655071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.657040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:02.680423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:02.681826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:02.682723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:02.682723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:02.682723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:02.682723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:02.690182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 269/559] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:02.690182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.731973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0decb-e6e2-4452-9916-fe501cbf2feb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.741687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.769585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.770380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.770738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.771013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.783441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:02.792536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:02.793593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:02.794542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 291/560] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:02.795243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.831997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e719e-3e2e-4cba-9f03-e619cd0db7cb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.869157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.869952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.870231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.870506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.878156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.879283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:02.879595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:02.895387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:02.896443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 270/561] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:02.898324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:02.906617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71535884-5227-49e5-b2ec-76d73e62dfac None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:02.946054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:02.946988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.947273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.947548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.948909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:02.949235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:02.950628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b72d-193b-4d31-b1ef-3d8f844e7612 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:02.963457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 292/562] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:02.964529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b8a81-37cb-459d-9610-ca9a46f4b141 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:02.964851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b8a81-37cb-459d-9610-ca9a46f4b141 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:02.965128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b8a81-37cb-459d-9610-ca9a46f4b141 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:02.970366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 293/563] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:02.971130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b8a81-37cb-459d-9610-ca9a46f4b141 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.000876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.005057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec65af-87cf-41b2-ac56-b565428833cd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.039924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.041331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.041966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.042243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.042990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.043295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.045357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.054373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 271/564] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.055166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.082154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b8a81-37cb-459d-9610-ca9a46f4b141 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.116798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.119077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.119077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.119077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.119077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.119493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.120556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af629b-e90b-4e60-b116-d0ac3dc3f644 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.129134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.140386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 294/565] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:15:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.141947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.142230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.142506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.159270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:03.160452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:03.165863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017250-42cb-43b3-a444-05cdea2ef42d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.202412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.203784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.203784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.203784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.210996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.212268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:03.226440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:03.227392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:03.228281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 272/566] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:03.228801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.236299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 295/567] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:03.237169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.252252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.332750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401a9fd-01b2-42f4-b6a3-b2b7e79ad2f2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.352776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9fdba-0fa8-4b5e-9825-ac14a107a9a8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.372238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.373098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.373383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.373660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.381678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.385468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.387022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.392037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.393198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.396706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.396706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.406808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:03.407496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:03.408563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:03.409673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:03.409673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:03.409673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:03.409673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:03.411192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.413811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 273/568] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:03.414697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:03.433259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:03.434419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:03.435585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:03.435585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:03.435585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:03.435585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:03.437485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 296/569] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:03.438594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.489119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.517111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9622b-3b15-426d-a574-a5ff490b7fd8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.540724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2000470-0674-497e-87e7-ab6d78d5221c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.550418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.551084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.551356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.551631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.552416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.552752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.554180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.566717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 274/570] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.569773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.577092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643e739-348e-4c64-b859-66455a666567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.577888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643e739-348e-4c64-b859-66455a666567 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.578171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643e739-348e-4c64-b859-66455a666567 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.578447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643e739-348e-4c64-b859-66455a666567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.588974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643e739-348e-4c64-b859-66455a666567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d643e739-348e-4c64-b859-66455a666567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:03.596473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:03.597442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:03.598346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 297/571] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:03.599030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643e739-348e-4c64-b859-66455a666567 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.636827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.673930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd9766-1481-464d-93d8-643445613f8f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.696645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643e739-348e-4c64-b859-66455a666567 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.702646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.707378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.708032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.708318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.708593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.709349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.709657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.712594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d55533-ca98-4df4-9f41-5f3367e87ff2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.721877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 275/572] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.723169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a541f-b057-46f7-82ce-44054c471324 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.723457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a541f-b057-46f7-82ce-44054c471324 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.723733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a541f-b057-46f7-82ce-44054c471324 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.725219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 276/573] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:03.725834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a541f-b057-46f7-82ce-44054c471324 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.733761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.734421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.734700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.734972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.735692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.735997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.737382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.748948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 298/574] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.749714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.823687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a541f-b057-46f7-82ce-44054c471324 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.844793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.849416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c2ef9-af40-4a4f-a5d1-e6b4ed220f3c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:03.857401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.858050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.858342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.858616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.859441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=a73a2387e0164fc7936ae83eb81b818f) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.859755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.861193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.866768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 277/575] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/role_assignments?user.id=a73a2387e0164fc7936ae83eb81b818f&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.867534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:03.882408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:03.883098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.883380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.883652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.884760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:03.884760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:03.886155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf5846-4113-4ae6-bb01-b9950429bb7c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:03.895800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 299/576] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:03.898622 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:03.899184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:03.900258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:03.918539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:03.919895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:03.946197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:03.993043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 300/577] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:03.993923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.002317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6074cd-060e-4874-960b-51d8c6b25027 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.041403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.042199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.042481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.042755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.050738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.052166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:04.066721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:04.067670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:04.068659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 278/578] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:04.069283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.111961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.124131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6d0d3-175b-4bfc-b91f-2907e6d82481 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.159352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.160143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.160870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.161148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.168142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.169655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.172421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5e9d-dcb6-4e75-b7b0-6545f18c452d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:04.184195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:04.185684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:04.186564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 301/579] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:04.191390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.194146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.212545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.213507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.213854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.214228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.226616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.228085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:04.245464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:04.246339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:04.251924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:04.251924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:04.251924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:04.251924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:04.251924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 279/580] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:04.251924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.314055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae1563-750c-4a97-bc5d-f52b1571406b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.350287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.351079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.351362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.351640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.358530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff64190-1d62-40c6-9615-2d2672c0148c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.362617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:04.370240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:04.371330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:04.372362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:04.376537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 302/581] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:04.377346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.391530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.397276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.398050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.398545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.398829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.399666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:04.399978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.401572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.419959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 280/582] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:04.420812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.449204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.499686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b99a7-916e-47f6-836e-5886c907c967 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.525054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e4edf-f645-4486-8f93-1792d63a7159 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.539222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.539871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.540153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.540757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.543985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:04.543985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.543985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.556398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 303/583] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:04.557478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.575010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.576695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.577123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.577695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.578953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:04.579670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.581607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.600027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 281/584] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:04.600027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.639101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.672272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b80cf1-a2ac-406f-b1e2-f60b57d90479 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.693626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.707926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.708319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398609f1-92c4-4b0b-bc57-a52606fe064b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.708755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.709039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.709313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.710055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:04.710364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.711716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.724852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 304/585] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:04.725508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.752100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.752915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.753198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.753478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.764102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.765677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:04.783678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:04.784805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:04.785882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:04.785882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:04.785882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:04.785882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:04.791162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 282/586] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:04.791162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:04.836775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f2d14-ba25-4732-843f-96b5cf60ad97 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.865421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.870426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.871389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.871739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.872082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/7be4c89082ac47d786cf7e1821ed01b3/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.886731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=7be4c89082ac47d786cf7e1821ed01b3, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.888941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.895799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb35a-f46e-42ee-9e13-90ee0326e98a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:04.927628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:04.928405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:04.928715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:04.929256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:04.937492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:04.938956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:04.941034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:04.955023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:04.956156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:15:04.957129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:04.960814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 283/587] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:04.961543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.036651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 305/588] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:04 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/7be4c89082ac47d786cf7e1821ed01b3/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:05.036651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.086284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec9b4e-9b10-4fc6-8251-c97595fb4926 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.137767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.139517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.139897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.140428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.147246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d8e96-7ccd-4fb0-8e13-d0acd66a7bd5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.155408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.157563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:05.179596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:05.181015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:05.181904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:05.181904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:05.181904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:05.181904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:05.181904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 284/589] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:05.182269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.191877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.193324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.193614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.193892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.194624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:05.195482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.197408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.213531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 306/590] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:05.214386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.239779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:05.269818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:05.308409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27e77b-4694-4e30-acc2-1cef45ec0645 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.348120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.348819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.349104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.349375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.350214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:05.350523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.351058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a896d4b-8009-41c4-b3c4-6bc3c531082e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.351950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.373008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 285/591] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:05.373859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.397038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.398403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.399202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.400099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.401299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:05.404566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.404566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.422225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 307/592] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:05.424149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.484772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0c9d-1ca0-44b7-8f0f-78fd3b50382f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.494735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:05.526375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.527556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.529036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.529538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.539233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.541894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.553684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47cff-d61d-496f-baa1-8589ad582279 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.555580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:05.564161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:05.570891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 286/593] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:05.571775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.598179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.599469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.599964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.600454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.612665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.614373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:05.633207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:05.634157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:05.635041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:05.635041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:05.635041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:05.635041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:05.637059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 308/594] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:05.638192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.695127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126f08-882c-4ec8-a9a4-ef719fd26f99 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.732128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.733214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.733557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.733932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.742340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.743910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:05.758883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:05.760044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 20:15:05.761233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:05.763239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 287/595] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:05.764289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.776291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb55145-c13d-408a-8458-d88c2ffae0c4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.805254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:05.813286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.814141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.814526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.814935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.816045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:05.816424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.817961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.838910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 309/596] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:05.838910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.853408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:05.907768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7d4e4-8c3f-4878-8479-06eba06af0cd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.949272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca03a0b-1c2c-42ef-a8a5-f34d8ae1b664 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:05.956440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.957317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.957696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.958070 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.958948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:05.959424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:05.961027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:05.974653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 288/597] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:05.975719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:05.995477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:05.996403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:05.996864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:05.997315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:05.998716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:05.999175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.001310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.021993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 310/598] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Jun 16 20:15:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:06.023040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.066789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:06.079780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf471-0f04-4f15-aab9-2c5b8b0c3429 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.099540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:06.116063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.116990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.117328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.117608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/37174d8d343d4989a8c41b4d43246c0e/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.129682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33c02-deb9-4d04-b3ac-539f82fecab2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.133117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=37174d8d343d4989a8c41b4d43246c0e, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.134550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.163924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.164809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.165095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.165374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.172399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.173935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-53c937ee-d696-4ddf-98f3-a8e9de001359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:06.189060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:06.190020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:06.190962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 311/599] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:06.191923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789e728-8890-447b-b6b1-f7725cf4c91b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.191923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789e728-8890-447b-b6b1-f7725cf4c91b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.192111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789e728-8890-447b-b6b1-f7725cf4c91b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.193477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 312/600] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:06.193991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789e728-8890-447b-b6b1-f7725cf4c91b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.211192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 289/601] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:05 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/37174d8d343d4989a8c41b4d43246c0e/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:06.212749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.319264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789e728-8890-447b-b6b1-f7725cf4c91b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.336039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c03c2-968a-4459-b8f6-8565a62f0872 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.354405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:06.360755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.365556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.365556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.365556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.375136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.375803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.376086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.376361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.377195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:06.377417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.377531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.378926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cca059-54ab-4cf9-885d-327732d15581 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.379329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.386212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:06.394286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 290/602] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:06.395571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.399932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.399932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:06.402892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:06.406282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:06.407598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:06.407598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:06.407598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:06.407598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:06.407598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 313/603] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:06.407598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.419943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:06.422659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:06.516892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 291/604] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:06.518135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.530972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d2365-c841-49b8-ac63-435b60549ec8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.567343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.568227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.568510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.568810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/21161c14bb024771be73ce9248ef515c/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.587809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=21161c14bb024771be73ce9248ef515c, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.589500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.624785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb423a-8019-4b3a-8886-851a3739cc20 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.653812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:06.668647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 314/605] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:06 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/21161c14bb024771be73ce9248ef515c/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:06.669370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.669370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.669370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.669370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.669698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:06.669698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.669698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.672144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.686657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 292/606] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:06.692703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.746022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:06.878750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85c517-8f96-49e9-94ed-a71db0819bae None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.889507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db434d70-a9fb-4974-849f-7f4ef6e12edc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:06.924138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.925154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.925435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.925708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.938215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:06.939287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:06.939649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:06.940072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:06.940495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:06.947712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:06.948241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:06.949423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:06.951010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:06.953000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 315/607] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:06.953248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:06.959175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:06.973599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:06.974560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:06.975442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 293/608] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:06.980631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.086443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:07.138163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:07.152965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e4631-9049-446a-bb7d-5d21f107a8a4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:07.178895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e07afa-c6a1-4cab-97ae-5d91689ccf76 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:07.227715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:07.228505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.228875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.229217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.230065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:07.232865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:07.234359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:07.249999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 316/609] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:07.252172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:07.252931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.253284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.253627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.254556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:07.255537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.256241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:07.259905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace182d3-e7fe-4443-b55b-4b1a67ed54c4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:07.285628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 294/610] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:07.287191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882075a-aa7b-4c17-9e7f-6cb2c992d462 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.288704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882075a-aa7b-4c17-9e7f-6cb2c992d462 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.289819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b882075a-aa7b-4c17-9e7f-6cb2c992d462 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.291265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 295/611] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:07.293527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882075a-aa7b-4c17-9e7f-6cb2c992d462 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.396665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34131fa5-5d7d-49b3-8c50-bdfa81d97bd7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:07.424462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b882075a-aa7b-4c17-9e7f-6cb2c992d462 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:07.439958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:07.441218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.441586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.441938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.449026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:07.457349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:07.459662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:07.476656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:07.476656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.476656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.476656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/046675b504304fb6991ff823ef931802/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-4ec6979e-2121-4769-8bdc-04c8309f5f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:07.485851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:07.486864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:07.488023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:07.488023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:07.488023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:07.488023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:07.490018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 317/612] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:07.491022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.491448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.491850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.493505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=046675b504304fb6991ff823ef931802, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:07.495107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:07.515145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:07.516648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:07.518817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:07.576117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 296/613] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:07 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/046675b504304fb6991ff823ef931802/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:07.576995 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.618090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 318/614] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:07.657024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.769221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7043e-9bf2-44ab-af74-5542bf367015 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:07.806598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:07.807253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.807531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.807799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.808638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:07.808995 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:07.810970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:07.821781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155fdfc-2d20-4b7e-bc7a-454a1c8dd812 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:07.824601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 297/615] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:07.830933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.854610 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:07.860832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:07.861874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:07.862378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:07.862880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:07.871549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:07.879373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:07.891455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:07.892389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:07.893713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:07.896817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 319/616] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:07.904543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:07.999654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b715690-16e2-4540-bb30-8536e2c4db54 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.046023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.047345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.047869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.048436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.056356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.058093 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:08.073543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:08.074535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:08.075507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:08.078248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 298/617] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:08.083390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.099548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143d6f6-bddd-41ad-a301-3363ed11c1f2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.169238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:08.188860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d049ac-2689-469f-9373-897d68ebbc55 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.203268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.203966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.204218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.204495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.205267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:08.205571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.206954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.227340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.228353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.228897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.229024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 320/618] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:08.230071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.231141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:08.231651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.233567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.234081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.253719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 299/619] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:08.259691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.362948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c53ac-685c-4cd9-9b83-9538f284ec56 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.370810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:08.399281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.400433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.400940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.401411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.405260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:08.414539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.419343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:08.435764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:08.436731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:08.437630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:08.437630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:08.437630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:08.437630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:08.437630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 300/620] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:08.446084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.466510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ba7c-2abb-4bfe-8b56-b50b2a73913f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.507856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.508588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.508898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.509171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.533726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.535193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:08.575575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:08.576575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:08.577563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:08.577563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:08.577563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:08.577563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:08.578228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 321/621] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:08.584238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.631125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d716f75-6e50-4211-b89a-0e62383c56d8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.713336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.714007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.714285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.714557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.715290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:08.715627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.717023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.729562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 301/622] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:08.730228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f95358-2916-4c77-8a19-c041298b445a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.734813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.748657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:08.768628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.769228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.769521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.769799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.770522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:08.770835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.772413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6298cc13-ca43-4fff-8be5-407526e2618f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.789959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 322/623] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:08.791291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66225-6ab7-4752-9a35-2d4080914738 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.791586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66225-6ab7-4752-9a35-2d4080914738 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.791870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc66225-6ab7-4752-9a35-2d4080914738 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.795189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 323/624] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:08.796179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc66225-6ab7-4752-9a35-2d4080914738 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:08.800961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:08.839680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa5609-536f-4a55-812b-2bbc696e5b89 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.874850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.875631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.875912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.876186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.882962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.884394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-26d3e717-0033-454b-80e4-4794ac079e87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:08.898949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:08.899888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:08.900833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 302/625] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:08.905878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc66225-6ab7-4752-9a35-2d4080914738 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:08.906430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.906714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.906990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.924932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:08.926118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:08.943375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:08.944314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:08.944601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:08.944907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:08.953486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:08.955041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:08.971205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:08.973519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:08.975816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:08.984651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 324/626] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:08.984651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.013055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 303/627] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:09.014736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.032644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.089022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.113946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12250e-fc6e-4b8d-bbe7-d5d5f8faeabc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.137816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd1230-229b-47d6-9179-b0eacaaafbc6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.152149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.152831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.153149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.153424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.154222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:09.154525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:09.155942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:09.167971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 325/628] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:09.169309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.183067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.183812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.184115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.185021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.185861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:09.186165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:09.187587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f809c2-f3b2-49aa-baca-c5177edc1f64 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:09.204056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 304/629] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:09.205497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894b62-9df1-4f3f-ae29-8375b490a3dd None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.205793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894b62-9df1-4f3f-ae29-8375b490a3dd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.206072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8894b62-9df1-4f3f-ae29-8375b490a3dd None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.208651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 305/630] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:09.208651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894b62-9df1-4f3f-ae29-8375b490a3dd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.272704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.282849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0df7d4-74ec-4d35-a76c-225ba5223fcb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.302564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.309268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8894b62-9df1-4f3f-ae29-8375b490a3dd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.319024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.319813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.320147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.320427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.330845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:09.338751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:09.339689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 326/631] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:09.341557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.348481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c842f95-12cc-4c9b-aa26-05778aa10fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.349397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842f95-12cc-4c9b-aa26-05778aa10fcb None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.349687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842f95-12cc-4c9b-aa26-05778aa10fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.349964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c842f95-12cc-4c9b-aa26-05778aa10fcb None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/a73a2387e0164fc7936ae83eb81b818f/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.365760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c842f95-12cc-4c9b-aa26-05778aa10fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=a73a2387e0164fc7936ae83eb81b818f, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:09.367194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c842f95-12cc-4c9b-aa26-05778aa10fcb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:09.441959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665e7b-7cac-478e-bbda-11b0f17d032b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.450802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 306/632] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:09 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/a73a2387e0164fc7936ae83eb81b818f/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:09.452313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.452668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.452952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.478165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:09.479637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:09.495964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.497039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.497545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.497979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.545128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.587301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 307/633] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:09.588752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.594392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:09.595899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:09.683800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.711730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c3ee-aac3-4a36-ada4-65e41a541948 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.730407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 327/634] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:09.731445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.755543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.756223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.756506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.757076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.757833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:09.758396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:09.760442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:09.772419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 308/635] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:09.773282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.795929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.852113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96add898-6a25-48e9-9cbf-1bfd86569bcf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.893703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.894670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.895043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.895320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.897316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d169521-1303-4a6f-80fa-c758efd6577d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:09.908325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:09.918282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:09.919476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 328/636] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:09.920963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:09.938956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:09.940253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:09.940783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:09.941301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:09.949433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:09.955144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:09.956899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:09.977976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:09.978967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:09.979879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:09.979879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:09.979879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:09.979879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:09.983524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 309/637] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:09.985478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.047781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3292ba-86a3-4ca0-9319-b7ba23d95ed1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.061203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.081961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.082742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.083024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.083300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.093705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.095257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.098160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a1ba2-9abb-4511-98e2-08006f8c0ad9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:10.114849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:10.115728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:10.117119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:10.117119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:10.117119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:10.117119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:10.117119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 329/638] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:10.117119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.138382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.139050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.139333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.139608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.140370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:10.140710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.142069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795db4e-a2b6-4b03-9f17-46e92f157576 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.150255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 310/639] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:10.150255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d9a0-beb5-4e37-aec0-86288562081f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.150255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d9a0-beb5-4e37-aec0-86288562081f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.150255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69d9a0-beb5-4e37-aec0-86288562081f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.150255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 311/640] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:10.150255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69d9a0-beb5-4e37-aec0-86288562081f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.212427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.227451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c714d-eb7b-4618-b4ab-3dfe2830c9f0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.261065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.261627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.261896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.262380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.263101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:10.263421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.264795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.269873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69d9a0-beb5-4e37-aec0-86288562081f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.282612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 330/641] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:10.282612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.304870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.305417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.305696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.305967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.306681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:10.306979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.308321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f39e2-9806-4a40-a1ae-fd883d67c38b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.309383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.320429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 312/642] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:10.322423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.322423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.322423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.338414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:10.339581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:10.392105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4543-c2e5-4ddb-847f-decc787db502 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.410555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 313/643] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:10.411628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.435409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.436918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.437385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.437857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.451016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.452593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.466507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:10.470898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:10.471855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:10.472875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:10.472875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:10.472875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:10.472875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:10.472875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 331/644] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:10.472875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.530107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d4cb8-b12d-492c-a9c4-60939c81d13c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.561105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.571173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.571969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.572251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.572520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.579790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.581276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.585254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36678aea-2494-4088-ac6d-69b055302f42 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:10.595549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:10.596438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 314/645] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:10.597508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.626861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.627653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.627940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.628214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.635527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.636999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:10.651984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:10.653618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:10.654560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 332/646] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:10.655835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.713159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf191c-7ce5-464d-b9f5-bb43f909afb4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.714786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.748014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.748838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.749124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.749402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.759820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:10.763601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414f6f-80e9-4aa3-8ed4-7ee59ae38708 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:10.768334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:10.769445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:10.770297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:10.772926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 315/647] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:10.774491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.801359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.802023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.802303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.802579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.803301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:10.803607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.805020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.808379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.819085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 333/648] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:10.819826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.893091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494dd759-8cf3-4b5f-b21b-730c97e78ac4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.922632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7e2ce-fa60-48ad-9f56-107dc5ac2d73 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:10.927978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.928655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.928946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.929221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.930010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:10.930325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.931853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.944187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 316/649] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:10.945118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:10.962337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:10.963008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:10.963293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:10.963571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:10.964426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:10.964748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:10.966691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:10.977074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:10.984863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 334/650] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:10.989508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.055668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.057784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110b18-0a2f-4de0-8a13-10c6f757ae98 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.093987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.094572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.094856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.095313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.095948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:11.096226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.097567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.101255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbfe90-13c1-47bd-86aa-b10a3ae3a0e1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.111895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 317/651] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:11.111895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.140462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.141297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.141579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.141860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.149426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.150969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:11.166078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:11.167049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:11.167986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 335/652] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:11.168682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.210914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.231518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb18bb-c73c-47b2-81ee-71cb6418b58a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.268997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.269651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.269933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.270205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.271044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=7be4c89082ac47d786cf7e1821ed01b3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:11.271354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.272253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bab46-0d7c-44d4-b724-57dff4d2eb68 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.272790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.288646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 318/653] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/role_assignments?user.id=7be4c89082ac47d786cf7e1821ed01b3&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:11.288646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.298948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.330919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e6259-a590-4312-800d-59886980b667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.331730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6259-a590-4312-800d-59886980b667 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.332093 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6259-a590-4312-800d-59886980b667 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.332442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6259-a590-4312-800d-59886980b667 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.405747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94730303-4aae-4bab-b462-5a1ab009690d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.428525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e6259-a590-4312-800d-59886980b667 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.430190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e6259-a590-4312-800d-59886980b667 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.443827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.444638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.445002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.445276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.457774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.459336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.471403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:11.481787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:11.487660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:11.488546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:11.488546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:11.488546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:11.488546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:11.488546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 319/654] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:11.488546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.565907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 336/655] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:11.566791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e6259-a590-4312-800d-59886980b667 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.587507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.611357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86265082-fc62-426f-8588-8b90e6e0834d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.649954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.651577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.651872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.652150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.653066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:11.653382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.654823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.677437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 320/656] 10.222.0.65 () {56 vars in 1137 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:11.678197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.680878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e6259-a590-4312-800d-59886980b667 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.716998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.717763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.718106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.718452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.719243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:11.719554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.720985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccf400-b06b-4066-b369-0c4bf923182b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.737076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 337/657] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:11.737076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba649-5453-493a-9415-162fb8d41bf5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.737076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba649-5453-493a-9415-162fb8d41bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.737076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83ba649-5453-493a-9415-162fb8d41bf5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.737815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 338/658] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:11.741814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba649-5453-493a-9415-162fb8d41bf5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.742533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.781482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b40a-214d-45bd-b5d6-a90e8e8423cf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.819942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:11.823911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.825663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.826091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.826635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.838589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.840065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.846709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83ba649-5453-493a-9415-162fb8d41bf5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:11.857589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:11.858509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:11.859424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:11.859424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:11.859424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:11.859424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:11.859424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 321/659] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:11.859712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:11.892398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:11.893078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:11.893362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:11.893632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:11.964451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:11.966447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:11.968509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43489e7d-dad9-4dd8-bd63-df55de012db1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:11.979095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.002754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.003547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.003831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.004113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.012797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.014591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f7f475bb-1cab-4984-99c1-ddbad3e9b5cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:12.029733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:12.030683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:12.031625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 322/660] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:12.032237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.032307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.033028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.045819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.054841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:12.056518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:12.071598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 339/661] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:12.077315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.128628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 323/662] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:12.129512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.193341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6d76-3b90-4d60-979b-b74f59b65631 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.228839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.229423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.229705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.229982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.230746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:12.231055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.232425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.234043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.237200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc95a8b-90e5-4b2c-b31e-8cbb3dd43ebd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.248153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 340/663] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:12.248153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.275487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.276155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.276433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.276737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.278190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:12.278506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.279927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.285282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.301497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 324/664] 10.222.0.65 () {56 vars in 1139 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:12.301497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.366920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f2573f-f684-43ce-8696-87d6aefc4b8d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.399885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44f5be-719d-4740-9cf6-62351492bcbe None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.408209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.409063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.409565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.409565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.419833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.421553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.435326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.436114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.436397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.436707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:12.439973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:12.440865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:12.441767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:12.441767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:12.441767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:12.441767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:12.445660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 341/665] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:12.446436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.449138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:12.457396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:12.458320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:12.459159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 325/666] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:12.460842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.479280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.549899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.569831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906b46a-16e7-410c-bbb0-66b1ee43c253 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.572653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76884e-4476-4410-bc45-8e285e6dd81f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.606470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.607158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.607279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.607529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.607802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.607916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.608072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.608340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.614608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.616050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:12.630270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:12.631179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:12.632109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 342/667] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:12.632607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.682390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.684560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.703111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.740176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566baf25-84d5-488c-8856-57c60014a506 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.782897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.783906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.784399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.784925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.785754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:12.786145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.787509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.798762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 326/668] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:12.798762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.812922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 343/669] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:12.813781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.823984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.908767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab9a9-b1d5-4ede-b2b5-a6a33a86c7b3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.920199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e688e-1996-4c8c-9be3-86e2a0d31547 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:12.926909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:12.943568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.944230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.944511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.944832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.945583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:12.945891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.947249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.955737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 327/670] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:12.956529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:12.963062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:12.963718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:12.964007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:12.964280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:12.965172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:12.965484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:12.966946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:12.984095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 344/671] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:12.984095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.054035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.070713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17573ac-ab23-479d-9186-239d9c9ffe55 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.092309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8135ce-c1d6-412a-8ff2-1c125d492a47 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.108181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.109223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.109501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.109771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.120655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.122740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.130064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.130923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.131206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.131482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.140229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.141715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:13.146631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:13.147512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:13.148418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:13.148418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:13.148418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:13.148418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:13.148418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 328/672] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:13.149365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:13.157468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:13.158374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:13.159240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:13.160938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 345/673] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:13.161971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.185347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.260647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d81608-dea9-4aa7-89ba-e4cfe93aabb8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.267189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ded968-e8ed-4cff-8d25-269ee19df173 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.297413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.298194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.298473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.298739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.302561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.309807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.311188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.312714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.316988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.316988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.316988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.316988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=37174d8d343d4989a8c41b4d43246c0e) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:13.316988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.317317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.332878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 346/674] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/role_assignments?user.id=37174d8d343d4989a8c41b4d43246c0e&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:13.332878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:13.333158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:13.333988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:13.334895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:13.334895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:13.334895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:13.334895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:13.334895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 329/675] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:13.334895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.448895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.467761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077426ea-9046-4476-9ae5-f575c688c2db None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.474448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96523b0-1f9d-4e1d-a546-8543b24c404e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.510246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.511044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.511336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.511616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.512607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:13.512960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.514534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.518392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.519042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.519322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.519594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.520342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:13.520684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.522102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.530557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 330/676] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:13.531442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.549217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 347/677] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:13.550091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.610543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.651184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def14ff2-1577-4c50-b8e0-7fc5ffa96d0e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.662805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f952f9e1-dbc3-4f3b-8bf9-3b492e0370d6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.686826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.687730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.688160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.688595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.689487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:13.689945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.691298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.701368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.702018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.702299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.702579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.707503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 331/678] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:13.707640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=21161c14bb024771be73ce9248ef515c) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:13.707640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.707835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.707933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535eb4de-7776-4e4f-9fed-03a355673f63 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.710796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.713557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 348/679] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/role_assignments?user.id=21161c14bb024771be73ce9248ef515c&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:13.720780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946946-ab30-456d-8f7a-c77fdd13d030 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.720780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946946-ab30-456d-8f7a-c77fdd13d030 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.720780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946946-ab30-456d-8f7a-c77fdd13d030 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.720780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 349/680] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:13.720780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946946-ab30-456d-8f7a-c77fdd13d030 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:13.828148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f29680-bb8c-4df2-ac3a-161fdc3cd3ec None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.861600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946946-ab30-456d-8f7a-c77fdd13d030 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:13.867358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.868304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.868733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.869104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.877524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.879152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.888210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-69e8ae7b-437c-41dc-ae3c-ccd20f31d500 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:13.900450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:13.901432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:13.902360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:13.903268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:13.904141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.904439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.904753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.906553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 332/681] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:13.908075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:13.908376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:13.912732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:13.919488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:13.921875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:13.940290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:13.941327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:13.942332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:13.942883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:13.942966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 350/682] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:13.943046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:13.943119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.017639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:14.029238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 333/683] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:14.030087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.072548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915c9e8-e424-494e-aa98-69c594e54ac6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.110482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.111261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.111550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.111913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.112744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:14.113060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:14.114612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:14.133131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 351/684] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:14.134081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.162467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34407f7d-5bb2-4c9f-98e6-1f7085e54014 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.179828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:14.202665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.203545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.203922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.204262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.205306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:14.205722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:14.207270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:14.236368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 334/685] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:14.237532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.272662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e77dc-b391-4441-871d-da803d079ee6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.294009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:14.320817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.321608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.322191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.322476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.335530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:14.345264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476234e-fce8-499b-8994-feeb8f3ca8fc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:14.345408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:14.346283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:14.347135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:14.351355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 352/686] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:14.353090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.386493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.387084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.387371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.387648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.388537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=046675b504304fb6991ff823ef931802) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:14.388832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:14.390266 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:14.401000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 335/687] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/role_assignments?user.id=046675b504304fb6991ff823ef931802&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:14.401892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.471774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:14.481061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f4279-ff4d-4382-a181-85f87d8cfee8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.532389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.534465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.534755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.535037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.639293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03504ae-c5ff-42d7-9572-8285669a0c92 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.662012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:14.668581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:14.670533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:14.684990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.686112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.686549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.687035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.688637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:14.689099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:14.691156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:14.704115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 336/688] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:14.710094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.796542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:14.807892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 353/689] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:14.814069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.834819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230dfcc1-4953-48e5-bf0a-47bd69e10b9c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:14.889998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:14.890775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:14.891055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:14.891326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:14.913527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:14.914978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:14.946122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:14.947080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:14.947990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:14.947990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:14.947990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:14.947990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:14.948670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 337/690] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:14.955782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:14.987933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc8da-1653-49c3-8dc9-81ad128ed265 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.017654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:15.052282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.053103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.053383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.053659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.072734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.075030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:15.105130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:15.106673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:15.107552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:15.107552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:15.107552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:15.107552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:15.114595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 354/691] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:15.118965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:15.145366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c112f3e-f55a-4546-b62e-a7bd327305dc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.201144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:15.210749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.211541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.211821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.212091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.212915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:15.213224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.223220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.235819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 338/692] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:15.242786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:15.290475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de4e56-35cb-4e53-84df-3db39e6cd8b7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.361195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:15.362709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.363393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.363661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.363937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.364695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:15.364995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.366367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.378801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e8eaa-4239-48fe-afbb-4e34b2c75278 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.390874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 355/693] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:15.396341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:15.452309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.454938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.456381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.456880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.474395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.476147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:15.502296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:15.503319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:15.504278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:15.511296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 339/694] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:15:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:15.512746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:15.577760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f9371-5dad-46d9-aeb6-bb0c716ed253 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.585714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:15.618530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.619333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.619616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.619892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.634569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.637598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:15.667883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:15.668902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:15.669787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:15.673774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 356/695] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:15.677424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:15.705837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6665d-c2b0-48af-943e-d7c2248c78cf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.743660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.744326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.744636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.744909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.745756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:15.746093 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.747517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977753-aee4-4073-a4c9-90fb2b250a85 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.767139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 340/696] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:15:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:15.768558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfc59e-4e1e-45a0-aabc-b49f6ddb5a6d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.768967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfc59e-4e1e-45a0-aabc-b49f6ddb5a6d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.769243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfc59e-4e1e-45a0-aabc-b49f6ddb5a6d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.774707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 341/697] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:15.775464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfc59e-4e1e-45a0-aabc-b49f6ddb5a6d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:15.787288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:15.824797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f07528-64ef-4c49-a107-af40c6f76bf6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.861568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.862496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.863034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.863557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.864596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:15.865282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:15.867029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ff07c-5a5c-47d7-84de-ed6319d9ca48 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:15.884939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 357/698] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:15.887298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26900-b465-4724-8937-e5e07251e69e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.887791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26900-b465-4724-8937-e5e07251e69e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.888297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f26900-b465-4724-8937-e5e07251e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.890763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfc59e-4e1e-45a0-aabc-b49f6ddb5a6d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:15.906504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-70f26900-b465-4724-8937-e5e07251e69e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:15.908130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-70f26900-b465-4724-8937-e5e07251e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:15.932927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:15.933538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:15.933822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:15.934101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:15.935471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.000964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 358/699] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:16.002182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26900-b465-4724-8937-e5e07251e69e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.019167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.020794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.033183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.127923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f26900-b465-4724-8937-e5e07251e69e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.150525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 342/700] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:16.151173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.168744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.170377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.170866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.171341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.172927 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=a73a2387e0164fc7936ae83eb81b818f) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:16.173450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.175588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0a933-daec-4651-9656-d622673fbb0c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.182190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 359/701] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/role_assignments?user.id=a73a2387e0164fc7936ae83eb81b818f&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:16.184160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c9cd-45fa-47ed-bbee-9ded1d5e0b8b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.184657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c9cd-45fa-47ed-bbee-9ded1d5e0b8b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.185097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9c9cd-45fa-47ed-bbee-9ded1d5e0b8b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.186789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 360/702] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:16.187717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c9cd-45fa-47ed-bbee-9ded1d5e0b8b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.219688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.271710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2767893f-1c89-4126-b60c-b05f910f9343 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.283734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.311701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.312647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.313054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.313404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.327174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.328792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.337973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9c9cd-45fa-47ed-bbee-9ded1d5e0b8b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-26a19460-23a8-4486-be37-9f44582bbf1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:16.347825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:16.348915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:16.349812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:16.349812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:16.349812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:16.349812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:16.353893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 343/703] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:16.355270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.355650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.355956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.373954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:16.375151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:16.390499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.391890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.392169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.392900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.406696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.408149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:16.430160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:16.434089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:16.435012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:16.435012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:16.435012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:16.435012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:16.435012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 361/704] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:16.435012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.462619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 344/705] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:16.463465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.528973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.563831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab3ea9-c071-4b1c-b871-a83d4b3cbe45 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.567620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.578179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70888d6-112d-488a-846e-1e85d4e2e450 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.601368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.602032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.602398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.602583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.603307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:16.603613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.605856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.616900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.617827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.618305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.623326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 362/706] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:16.623326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.624034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.625113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:16.625573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.627111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.645045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 345/707] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:16.646322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.725670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a972a-f834-4f18-a601-9c52a0798317 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.753572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff556a3-72c8-4b83-8f89-3ec588c5c85e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.762536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.763249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.763536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.763818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.764471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.766023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:16.781661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:16.782701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:16.783574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:16.785054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.787714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 363/708] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:16.788715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.797924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.799050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.799622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.800116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:16.801162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:16.802830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:16.889285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 346/709] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:15:16 2022] POST /identity/v3/users => generated 254 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:16.891220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:16.911388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:16.917056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f67789-1872-4d22-ab13-0786aaa5bb50 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:16.993542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:16.994274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:16.996829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:16.997130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.012602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.014121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-9c60550e-495c-4141-9339-5b4ddb487620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:17.036391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:17.037360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:17.038526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 364/710] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:17.042105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031727f5-eba8-445e-981d-ac95fd93b22a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.043265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031727f5-eba8-445e-981d-ac95fd93b22a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.043554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031727f5-eba8-445e-981d-ac95fd93b22a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.045418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 365/711] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:17.046193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031727f5-eba8-445e-981d-ac95fd93b22a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:17.090946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595f625-16b2-4c62-8391-ce81196243a4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:17.127840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:17.141371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:17.142054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.142793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.142793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.143558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:17.143558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.145660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac400b1-b5ea-4b22-9fae-5b1e981740c2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.152834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 347/712] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jun 16 20:15:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:17.154218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.154505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.154778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.175028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:17.176906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:17.187225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031727f5-eba8-445e-981d-ac95fd93b22a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:17.230875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:17.231973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.232810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.233602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.234713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:17.235225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.237209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.249076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:17.253909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 348/713] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:17.254679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 366/714] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:17.259602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:17.263976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:17.373584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e3b9b-38b9-4d2f-a675-0360a52b6c22 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:17.407722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77451d-1313-40a4-8072-6a22b1065918 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:17.409503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:17.410377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.410757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.411134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.412013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:17.412414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.413966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.426612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 349/715] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jun 16 20:15:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:17.427739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:17.429680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:17.455328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:17.456251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.457036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.457457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.458775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=7be4c89082ac47d786cf7e1821ed01b3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:17.459260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.461854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.476808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 367/716] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:17 2022] GET /identity/v3/role_assignments?user.id=7be4c89082ac47d786cf7e1821ed01b3&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:17.563907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:17.624533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb60f62-6a51-45c4-9d36-89add5435955 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:17.675107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:17.676051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.676426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.676819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] PATH_INFO: `/v3/services/network` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.677577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.679029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:17.693576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:17.694797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:17.695796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:17.697906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 350/717] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:17 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:17.704322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:17.807568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b6075-8555-437f-bf78-4927856c9a58 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:17.841601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:17.842409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:17.842784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:17.843152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:17.843959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] RBAC: Adding query filter params (name=network) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:17.844379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:17.845870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89474a5b-16f5-438d-a6bf-88a0252a6636 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:17.850828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 368/718] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:17.856457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:17.975567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d4e88-6c8b-4115-a51e-0866e9e68591 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:18.002571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:18.010907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:18.011598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:18.011878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:18.012361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:18.013162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] RBAC: Adding query filter params (type=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:18.023183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:18.023183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e4fc0-8d22-4e5b-b8d6-d0f31b828908 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:18.023183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 351/719] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:17 2022] GET /identity/v3/services?type=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:18.612785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02a41f-13fd-4058-955f-542fce417ebc None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:18.613082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02a41f-13fd-4058-955f-542fce417ebc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:18.613344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02a41f-13fd-4058-955f-542fce417ebc None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:18.614981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 369/720] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:18.620127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:18.620424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:18.621268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:18.638496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:18.639680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:18.733621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 352/721] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:18.769526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02a41f-13fd-4058-955f-542fce417ebc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:18.838509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:18.909261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02a41f-13fd-4058-955f-542fce417ebc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:18.956057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:18.956875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:18.957153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:18.957419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:18.972038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:18.979770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:18.981271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:18.982244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 370/722] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:18.989708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:19.134324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54030edb-b4f9-4b07-a596-f22a13d6a204 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:19.166401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:19.181846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:19.182518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:19.184409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:19.184409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:19.184409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:19.184671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:19.185992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:19.201019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 353/723] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:19.206625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:19.364190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768c2b6-f967-4dcf-b9a0-59cd3a4b80f8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:19.366506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:19.399392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:19.400847 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:19.401123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:19.401392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:19.411737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:19.413203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:19.431564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:19.432514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:19.434214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:19.434214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:19.434214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:19.434214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:19.434214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 371/724] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:19.438992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:19.547665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5214-787b-49d2-b6fe-7a1e0e11a70d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:19.603274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:19.604180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:19.604607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:19.605620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:19.606568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:19.607029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:19.608587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1c0ac-8f83-4153-81bf-e84aa1dbdfa1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:19.626241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 354/725] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:19.629624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:19.736595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25714609-57ba-44c6-bf73-82db1aeda071 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:19.781039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fdd7b-7750-4105-937b-445bdc28d90b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:19.781561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fdd7b-7750-4105-937b-445bdc28d90b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:19.781988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fdd7b-7750-4105-937b-445bdc28d90b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:19.783483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 355/726] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:19.785689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:19.787008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:19.787455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:19.787880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:19.789880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:19.790161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:19.790443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:19.796862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:19.798524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:19.815449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:19.816713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:19.817906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:19.820269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 372/727] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:19.828885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:19.829027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:19.830232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:19.852412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:19.908994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:19.965049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 356/728] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:19.989684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.003492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb046ed-d6a7-471f-9a42-8a996fbae6d1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.077412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.078019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.078311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.078595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.079449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:20.079765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:20.081229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f0631-9dfc-4424-a814-4372842a07c6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:20.101646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b8fa0-70cd-4e2c-b01c-54b891bdaaf6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.196705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bff65-5751-4a42-8a85-07ac9deddefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.197521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bff65-5751-4a42-8a85-07ac9deddefa None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.197806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bff65-5751-4a42-8a85-07ac9deddefa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.198083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bff65-5751-4a42-8a85-07ac9deddefa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.210702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bff65-5751-4a42-8a85-07ac9deddefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-649bff65-5751-4a42-8a85-07ac9deddefa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:20.218861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:20.219848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:20.220762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 357/729] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:20.221607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6775-32b6-49fb-a152-0f60ecedc3b7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.221817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6775-32b6-49fb-a152-0f60ecedc3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.222099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6775-32b6-49fb-a152-0f60ecedc3b7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.225074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 358/730] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:20.226345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff2e51-493b-4e55-9a19-096a2acef6f4 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.226636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff2e51-493b-4e55-9a19-096a2acef6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.226917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff2e51-493b-4e55-9a19-096a2acef6f4 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.228210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 359/731] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:20.228941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff2e51-493b-4e55-9a19-096a2acef6f4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.249180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 373/732] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Jun 16 20:15:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:20.250659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412dd5-db35-48f4-a938-592850fad35e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.251104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412dd5-db35-48f4-a938-592850fad35e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.251553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61412dd5-db35-48f4-a938-592850fad35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.268258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-61412dd5-db35-48f4-a938-592850fad35e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:20.269998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-61412dd5-db35-48f4-a938-592850fad35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:20.270815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:20.345524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff2e51-493b-4e55-9a19-096a2acef6f4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.357043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 374/733] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:20.357043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.357043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.357043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.360413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:20.371989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:20.375353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:20.390731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.391506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.391794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.392079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.392862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:20.393172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:20.394537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:20.410029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 360/734] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:20.410029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.449198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 375/735] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:20.450288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.528644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:20.534251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513233f-24ab-4bae-916f-aff42c7c2a02 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.574588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.575243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.575526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.575801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.576038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a7aaa-6a30-4c7e-9a24-75da4df7d7f6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.614428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.615096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.615376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.615676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.616828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:20.618543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:20.621770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:20.644941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:20.646406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:20.726910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 376/736] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:20 2022] POST /identity/v3/services => generated 251 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:20.737800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.739576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:20.747081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 361/737] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 20:15:20.747783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.886336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9529d-a9c9-445d-ac56-f1e6bf77ec90 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.897379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c44ae9a-6774-4817-bbe8-eae9d8a8856e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:20.934881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.935695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.935981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.936257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.937471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:20.938360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.938648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.938924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.947431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:20.948931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:20.950533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:20.958642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:20.959566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:20.960431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 362/738] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:20.961179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-05ddc46d-1a97-4416-881b-94c45deb9829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:20.966979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:20.968020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:20.969150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:20.969150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:20.969150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:20.969150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:20.969150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 377/739] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:20.969501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de83afd-dfda-48ce-8c45-a456f28226d1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:20.973785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de83afd-dfda-48ce-8c45-a456f28226d1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:20.973785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de83afd-dfda-48ce-8c45-a456f28226d1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:20.973785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 378/740] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:20.973785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de83afd-dfda-48ce-8c45-a456f28226d1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.023835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.025572 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.069312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683c0b-0034-45f0-aafb-cc9b7f852d96 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.086675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de83afd-dfda-48ce-8c45-a456f28226d1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.103798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.104587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.105419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.105696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.117140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.118582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.123079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.123744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.124028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.124306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.125326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:21.125434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.126743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.144427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 379/741] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-488391a9-7291-4e83-88a6-30ae13055d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:21.144777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:21.145638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:21.146585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:21.146585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:21.146585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:21.146585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:21.146817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.146899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 363/742] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:21.146899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.146899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.146899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.160445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:21.161646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:21.232726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 364/743] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 20:15:21.232726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.263809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50786f6b-ff47-4173-9ac0-d1d5ebff713f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.267374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.273143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.303541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.304202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.304489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.304869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.305635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:21.305950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.307399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.325413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 380/744] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:21.325413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.342589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a474b6-5220-4de1-9030-7748e5f039f1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.380908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.381693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.381980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.382420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.392983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.394426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:21.412284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:21.413254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:21.414841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:21.414841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:21.414841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:21.414841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:21.414841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 365/745] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:21.414841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.435214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378caf-73ab-48c9-8707-da6ca7337d91 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.470497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.471202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.471488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.471765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.472488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:21.472824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.474185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.485951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 381/746] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:21.486737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.513851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.516161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.525675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c011561-c072-4225-bc8b-8aef7660bbf6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.562406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.563067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.563353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.563625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.564350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.565852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.597253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b96773-417d-4416-b616-8e3a2ce4e5c8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.636650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 366/747] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:21 2022] POST /identity/v3/services => generated 240 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:21.636650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.648089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.649227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.649504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.649771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.658672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.660255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:21.679412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:21.680743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:21.681901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:21.686023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 382/748] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:21.686948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.769699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997623e7-2117-4fe2-81db-1feb20a72b85 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.786742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.808876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.809555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.809836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.810112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.810378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67ab9-a15d-4498-963b-8695a40eeb7b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.810852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:21.811246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.812890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.829144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 367/749] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:21.830258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.845314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:21.863347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:21.865826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:21.865826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:21.865826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:21.877202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:21.879326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:21.895948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:21.897017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:21.898361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 383/750] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:21.898858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:21.956087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872f5d3-1693-4a6c-a527-b8e3445ee41e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:21.999848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.000837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.001267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.002174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.003168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:22.003628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.005577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.029773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 368/751] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:22.030288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19569f1b-aa58-4558-89bb-ae7713d3422c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.031152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.066432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.067580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.067881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.068162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.077948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.079391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:22.096647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:22.097642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:22.098585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:22.100689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 384/752] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:15:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:22.101715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.117179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:22.161263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f7461-76e8-4267-9600-c664c5a021ab None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.210026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.211168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.211624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.212481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.213751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:22.214770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.217044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.231609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36977f-0d0e-4f6c-b6f1-ffc9818580a3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.235736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 369/753] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:22.236764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.280325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.281288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.281719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.282141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.357643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:22.361256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.362913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.489610 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 385/754] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:15:22.490676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.491714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539cf77-9727-42f8-a038-923b5d27a429 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.520924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:22.529166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.530144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.530523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.538164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.538164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:22.538164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.538164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.566533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 370/755] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:22.567557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.630521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:22.633784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125369f-6f21-402e-a463-42523a5a3058 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.677902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.678194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e23c3d-4995-4a09-92ee-88aa7a7aa51b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.678816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.679191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.679560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.680489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=a73a2387e0164fc7936ae83eb81b818f) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:22.680920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.683168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.696724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 386/756] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/role_assignments?user.id=a73a2387e0164fc7936ae83eb81b818f&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:22.696724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.755671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.757303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.757959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.758754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.791120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.794400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.805159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffcc89-1413-46f6-859f-d630c40c7471 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:22.836692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:22.837801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:22.839273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:22.839273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:22.839273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:22.839273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:22.845096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 371/757] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:22.849751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:22.850712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:22.851087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:22.851429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:22.853491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.864747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:22.867297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:22.887448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:22.888441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:22.889378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:22.889378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:22.889378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:22.889378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:22.889378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 387/758] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:22.895105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:22.920540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:22.941487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.009143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e076b-77e7-40d5-ab31-4a3d19667fec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.045675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.046804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.047287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.047787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.048728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:23.049208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.050836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a800e2-a0c3-4b64-a083-9b292f5f76a8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.062738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e08e9-adb3-4be9-9163-715d85b8f36d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.064803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 388/759] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:23.066365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf83eb-9bba-4293-874a-a0a42e9bd900 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.066828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf83eb-9bba-4293-874a-a0a42e9bd900 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.067274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf83eb-9bba-4293-874a-a0a42e9bd900 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.068978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 389/760] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:23.075036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.075534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.075967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.099946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.100649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.100938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.101256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.102018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:23.102126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:23.102325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.103693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.103897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:23.122228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 372/761] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:23.123166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.196599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 390/762] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:23.197887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.207611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.250526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.254535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a9e96-72fd-4960-8043-d7028eae1e7d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.292650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.293402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.293682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.293955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.304363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.305958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.320416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec59b4-a64a-48ed-ac50-b1308b63ce7f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:23.321067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:23.321924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:23.322817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:23.327834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 373/763] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:23.328696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.369566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.371246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.371702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.372125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.382061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.384188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:23.404459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:23.411394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 391/764] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:23.412521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.441814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be904e-b855-4d2d-b854-2eacd0eaff55 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.478660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.480354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.480886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.481390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.482261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.483819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.494049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:23.497157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:23.498077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:23.498947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:23.506863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 374/765] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:23.516109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.538383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46733b4f-b510-4f2b-85c7-03de2f7f34cf None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.543852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.583300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.583967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.584249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.584522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.585395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:23.585703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.587371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.605931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 392/766] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:23.605931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.648863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e879-6f84-4605-85fb-4b23b829045f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.690129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.690456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.690733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.691007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.691805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:23.692114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.693680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.711435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 375/767] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:23.712297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.728171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542fa52-3a1b-49f0-b15e-64146f1e82fc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.762050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.773717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.775102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.775848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.776379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.777431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:23.777746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.779114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.788644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 393/768] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:23.789512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.805244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:23.833443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d697a03-3f1e-44fc-91d4-bf487658c42e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.873411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a215e-c826-4890-b335-dd41c63cdf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.874702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a215e-c826-4890-b335-dd41c63cdf1c None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.874702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a215e-c826-4890-b335-dd41c63cdf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.874903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a215e-c826-4890-b335-dd41c63cdf1c None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/7be4c89082ac47d786cf7e1821ed01b3/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.876883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a215e-c826-4890-b335-dd41c63cdf1c None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=7be4c89082ac47d786cf7e1821ed01b3, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.878310 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a215e-c826-4890-b335-dd41c63cdf1c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.909414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c341-7709-4788-ba11-2680ed3c4fd4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:23.943634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:23.944320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.944573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.944882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.945736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=8110296d70974b79a7b8d3847f290990) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:23.946051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:23.947475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:23.954573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 394/769] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/role_assignments?user.id=8110296d70974b79a7b8d3847f290990&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:23.955452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:23.955858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 376/770] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:23 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/7be4c89082ac47d786cf7e1821ed01b3/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:23.957393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cd382-2aee-4b83-ace7-315667d8d3ca None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.957823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cd382-2aee-4b83-ace7-315667d8d3ca None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.958233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cd382-2aee-4b83-ace7-315667d8d3ca None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.964236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 377/771] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:23.965935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:23.966474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:23.966941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:23.993622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:23.995810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:24.089522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:24.130509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 378/772] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:24.164028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f480c62-52d8-42a4-a1c9-4eeda7b9998d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.167384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:24.205621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.206289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.206571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.206854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.207559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:24.207863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.209435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.216787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 395/773] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jun 16 20:15:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:24.222455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:24.253347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:24.293712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96efcafc-2606-446e-a0c2-f65044ea0107 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.332585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7330cd0e-157e-4b28-b6be-0e0cba471d42 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.344158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.345443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.345827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.346175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.347198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.348967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.353245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:24.365739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:24.367172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:24.369412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 379/774] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:24.377734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:24.383423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.384145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.384424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.384721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.385569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] RBAC: Adding query filter params (interface=public, service_id=47ac6a5685dc448db916fc98d28f45a1, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:24.385879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.387265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.405877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 396/775] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/endpoints?service_id=47ac6a5685dc448db916fc98d28f45a1&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:24.416161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:24.509241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a014a2e-16d2-4a88-abb3-9c395f2001c8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.568463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.569216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.569495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.569771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.570536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] RBAC: Adding query filter params (name=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:24.570845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.572206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.580975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:24.583858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 380/776] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:24.593632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:24.599378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec620d9-b679-487c-b3ff-d77db6fc089b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.646725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.647647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.648108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.648531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.649386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.650902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.661451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 397/777] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:24.767077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca52a8c-18b5-45a6-8034-4475b6595f96 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.820233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.821223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.821655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.822080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.823581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] RBAC: Adding query filter params (type=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:24.824047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.825579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.835960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 381/778] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:24.837164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:24.888182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:24.944292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12eaf4a-9af5-4d0a-82ab-0f90837ef42a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:24.982645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:24.983567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:24.984004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:24.984459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:24.985429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] RBAC: Adding query filter params (interface=public, service_id=4ca7e86de5ad422aacb24cc5055d5b62, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:24.985907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:24.987420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1094b9-b787-4137-b3a9-a54d37c2367a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:24.993563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 398/779] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/endpoints?service_id=4ca7e86de5ad422aacb24cc5055d5b62&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:24.999333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:25.073750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:25.098483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596be9-2b09-4de0-a29e-5fc8a9d14114 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:25.098794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596be9-2b09-4de0-a29e-5fc8a9d14114 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:25.099040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596be9-2b09-4de0-a29e-5fc8a9d14114 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:25.100598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 399/780] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:25.105879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:25.106410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:25.106886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:25.112036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f10bd-18b0-465a-8454-1b8836796989 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:25.125488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:25.126945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:25.154602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:25.155222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:25.155777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:25.156076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:25.156945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:25.158699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:25.166168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 382/781] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:24 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:25.223277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 400/782] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:25.258879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:25.384306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b049b7-d5e6-4e52-a86d-f856ca0c97c0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:25.414070 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:25.423380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:25.424195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:25.424482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:25.424799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:25.438687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:25.446520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:25.447454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:25.448941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 383/783] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:25.455984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:25.506573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:25.573993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c015dfc-ad25-426b-a0d1-3531046d8f25 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:25.616051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:25.616753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:25.617041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:25.617320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:25.618084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:25.618399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:25.619851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:25.629666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 401/784] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:25.636087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:25.748868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeccea-e309-4a24-a878-b79caf5d4e99 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:25.800052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:25.800865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:25.801150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:25.801423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:25.812396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:25.813866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:25.842962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:25.843873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:25.845422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:25.845422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:25.845422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:25.845422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:25.845422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 384/785] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:25.849716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:25.964813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ed5c0-0c97-4338-9399-152d744a5a51 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:25.966387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:26.011189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:26.011768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:26.012050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:26.012325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:26.013118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:26.013424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:26.014881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:26.031607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 402/786] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:26.037167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:26.098271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:26.168678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201dbaed-0151-488c-916a-31067aaafe83 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:26.212818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:26.214189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:26.214476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:26.214750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:26.227614 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:26.229134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:26.246722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:26.247671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:26.249482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 385/787] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:26.253630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:26.412950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68e58d-59a8-4af4-9d29-9de7176853f6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:26.462344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:26.463015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:26.463385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:26.464160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:26.465021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:26.465327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:26.466794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab6187-7b25-4885-8498-bf9e958490da None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:26.490270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 403/788] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Jun 16 20:15:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:26.495682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:26.676528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:26.681289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa7008-7d99-482c-b6ba-69860265c1dd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:26.730929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:26.731726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:26.732012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:26.732287 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:26.733190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5282f6-011c-4b15-841e-548f9d8014ff None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:26.733483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5282f6-011c-4b15-841e-548f9d8014ff None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:26.733757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5282f6-011c-4b15-841e-548f9d8014ff None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:26.735112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 404/789] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:15:26.740151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:26.740428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:26.740781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:26.750892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:26.752807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:26.757937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:26.759232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:26.779734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:26.780776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:26.781655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:26.781655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:26.781655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:26.781655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:26.787855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 386/790] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:26.788371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:26.791836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:26.880044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 405/791] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:26.937699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:26.963779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e00ab-ebe7-4bdc-abcd-27d566e3966e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.006963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.007790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.008399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.008728 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.009743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:27.010055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.012254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724939c-817c-4359-a18e-689e2d888fb8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.026681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 387/792] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:27.027979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632d2dd-14ec-4065-bb0d-9ea14126498b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.028268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632d2dd-14ec-4065-bb0d-9ea14126498b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.028547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632d2dd-14ec-4065-bb0d-9ea14126498b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.032698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 388/793] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:27.033551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632d2dd-14ec-4065-bb0d-9ea14126498b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.050841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.060083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217d67e-fae2-43a3-92cb-30413685532a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.094782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8376a6-ef2f-4de4-98af-680ed477c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.095726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8376a6-ef2f-4de4-98af-680ed477c200 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.096126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8376a6-ef2f-4de4-98af-680ed477c200 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.096481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8376a6-ef2f-4de4-98af-680ed477c200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.107695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8376a6-ef2f-4de4-98af-680ed477c200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-ed8376a6-ef2f-4de4-98af-680ed477c200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:27.118232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:27.119163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:27.120567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:27.125153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 406/794] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:27.126442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.126732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.127117 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.139716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632d2dd-14ec-4065-bb0d-9ea14126498b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.144823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:27.146063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:27.149138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.177677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.178546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.178828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.179099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.187383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.188942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:27.204117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:27.205324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:27.206436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:27.210225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 389/795] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:27.210894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.232784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 407/796] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:27.233879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.282123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.318033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5fa7b9-cd70-448b-a6d0-b9a8705425ee None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.340906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0719024-636b-4c4e-8bf9-f0749aeadf29 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.355068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.355883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.356161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.356429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.357221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:27.357522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.358881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39246-aa5c-4d2b-b4aa-863ba1c40409 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.367306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 390/797] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:27.368657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac06a6-da41-4ab1-a75f-ff427a7e04da None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.368943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac06a6-da41-4ab1-a75f-ff427a7e04da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.369223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac06a6-da41-4ab1-a75f-ff427a7e04da None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.371159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 391/798] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:27.372198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac06a6-da41-4ab1-a75f-ff427a7e04da None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.384563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.386118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.386393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.386673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.387469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:27.387778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.389237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ae81c-ea89-4207-be9b-494a3433863d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.399627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.404426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 408/799] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:27.405653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.405945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.406225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.430172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:27.431570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:27.531127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac06a6-da41-4ab1-a75f-ff427a7e04da None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.531781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 409/800] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:27.531781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.578015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.578805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.579087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.579377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.581407 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.592691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:27.598393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:27.599386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:27.600240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 392/801] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:27.601064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.632364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5c81e-d03d-499e-a162-df9c387b6f9b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.665389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.672264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.673205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.673556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.673902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.684363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.685832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:27.705141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:27.706073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:27.706956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:27.706956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:27.706956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:27.706956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:27.711103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 410/802] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:27.711702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.720604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080b645-b51c-46b2-8076-0d8b178218db None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.762410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.763218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.763497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.763765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/a73a2387e0164fc7936ae83eb81b818f/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.765776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=a73a2387e0164fc7936ae83eb81b818f, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.767218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.813868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a06d160-1931-48f2-84be-a942001c6c30 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:27.846119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:27.846934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:27.847217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:27.847527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:27.848177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:27.849566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:27.864068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:27.865338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:27.872077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 411/803] 10.222.0.65 () {56 vars in 1129 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:27.872963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.876051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 393/804] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:27 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/a73a2387e0164fc7936ae83eb81b818f/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:27.878169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:27.949191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:27.966745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.019138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27829429-ecae-46be-b34c-04d85d0c8329 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.032797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32627080-a42f-49b4-80d6-de04b4356063 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.057458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.058121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.058403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.058677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.059409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:28.059715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.061149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.074479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.075070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.075355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.075635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.076387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:28.076724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.080482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7d692-fec5-49dd-ae92-145bc89c5d57 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.080643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 394/805] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:28.080643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.092951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 412/806] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:28.094210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58521a1-9f90-4ef5-9595-d28020ed6998 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.094502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58521a1-9f90-4ef5-9595-d28020ed6998 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.094781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58521a1-9f90-4ef5-9595-d28020ed6998 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.096126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 413/807] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:28.096709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58521a1-9f90-4ef5-9595-d28020ed6998 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.199222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd493d-2faf-4d89-bc5f-1df9601ef61c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.204697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58521a1-9f90-4ef5-9595-d28020ed6998 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.214641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.216218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.237505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.238159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.238440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.239490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.239490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:28.239741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.239834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.240590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.240892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.241079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf65cf8-f63c-4ad0-a232-e539c8db6c8c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.241186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.250435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 395/808] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:28.250435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.250435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.250435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.252144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.253755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.265177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:28.276733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:28.276854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:28.277723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 414/809] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:28.278674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.334706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 396/810] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:28.345511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.386619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a183f2f-c9ec-4554-b89b-9b920ab103d3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.422100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.422886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.423167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.423439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.434793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.436200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.451697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b86bcb-5ad5-465d-b786-43407259e0c1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:28.453787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:28.454730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:28.455654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:28.455654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:28.455654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:28.455654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:28.455654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 415/811] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:28.455925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.466492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.481638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.491272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.492442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.493105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.493875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.494653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:28.495019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.496389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.506004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 397/812] 10.222.0.65 () {56 vars in 1124 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:28.506004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.578734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2497e2-d8d6-436d-92e1-814d1d5294d5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.607261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627292b5-ecf7-4a4c-9223-9a9868881d6c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.612526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.613214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.613495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.613768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.614605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:28.614935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.616316 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.634197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 416/813] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:28.634919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.645671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.646468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.646750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.647023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.647685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.649079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:28.661202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:28.662255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:28.663102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 398/814] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/services/network => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:28.663904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.699478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.720678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.741186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f04fc9-292f-4b7f-8fe4-f4c1044e331a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.766619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8185102-9fe6-40f2-a09f-6a831e0225d1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.775335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.776794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.777081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.777356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.778193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:28.778500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.779917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.797937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 417/815] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:28.797937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.805970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.806615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.807825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.808099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.808868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.810906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.897147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54981a7-074c-4b28-ae3a-c89b0a1ba12f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:28.916860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 399/816] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:28.918080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:28.941841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:28.942663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:28.942949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:28.945700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:28.946614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:28.961242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:28.962950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:28.983089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:28.997867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:28.998767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:28.998767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:28.998767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:28.998767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:28.998767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 418/817] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:28.998767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.039452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:29.049062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851212-d680-4737-b849-b1ba1c7bab93 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.095774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.097113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.097544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.098241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.099491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] RBAC: Adding query filter params (name=network) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:29.099945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.102831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.110873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 400/818] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:29.112989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.120349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3e3e-10e1-44a9-8117-d14b8e907474 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.163732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.163732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.164020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.164093 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.172602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.174176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:29.189889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:29.190856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:29.191838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:29.194196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 419/819] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:15:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:29.195141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.228198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7e367-c1a8-4094-bf50-1ed5c9b3d773 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.249410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:29.272850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.273633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.273989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.274388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.275403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:29.276592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.278076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.299043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 401/820] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:29.299043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.316446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555e8ea-d2be-44c0-8574-00ae37e4fdbc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.318009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:29.352866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.354312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.354769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.355193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.356165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] RBAC: Adding query filter params (type=network) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:29.356641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.358213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.368382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 420/821] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:29.369491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.405820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba7de3-77b1-4ebd-9136-7be29e9cbc42 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.449248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.449970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.450337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.450949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.451900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:29.452337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.454125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.473599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 402/822] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:29.474636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.475421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7291-8ceb-481f-96b4-029c8a49ac2f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.487242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:29.511806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.512623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.512932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.513212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.526804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.526804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:29.537619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:29.538607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:29.539512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:29.544256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 421/823] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:29.545261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.601019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:29.629869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b3de0-f825-4bb1-bc66-d65717656520 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.662089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4d3ac-59d6-447f-89c7-8f0422ab100e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.669527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.670185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.670467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.670743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.671498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.672888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.702197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:29.703194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:29.703678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:29.704164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:29.745391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:29.757661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 403/824] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:29.758507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:29.802356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:29.803828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:29.981636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34741e42-ce68-4256-82fb-0de2cd4f7bc8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:29.982814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 422/825] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:15:29.988530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.016601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.027414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.028666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.029126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.029572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.033151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:30.033151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.033151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.045935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 404/826] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:30.051931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.071228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.119695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f98d4-6853-4a86-af1b-294c244dc761 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.158432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.159253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.159514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.159784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.172004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.173330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd7a8c-30f9-4317-859c-dc5d5707ea84 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.173462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-ef445709-7af9-4d2a-a3f5-c627cdd652db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:30.191653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:30.192640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:30.193588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:30.193588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:30.193588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:30.193588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:30.193588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 423/827] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:30.194462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a0a3f-2782-45b9-82ff-e3e8c26c8f66 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.194744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a0a3f-2782-45b9-82ff-e3e8c26c8f66 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.195018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a0a3f-2782-45b9-82ff-e3e8c26c8f66 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.196399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 424/828] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:30.202128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a0a3f-2782-45b9-82ff-e3e8c26c8f66 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.213941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ee8f1-b4e1-4ca1-a209-c60d989e1675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.214829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee8f1-b4e1-4ca1-a209-c60d989e1675 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.215115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee8f1-b4e1-4ca1-a209-c60d989e1675 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.215394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ee8f1-b4e1-4ca1-a209-c60d989e1675 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/8110296d70974b79a7b8d3847f290990/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.230302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ee8f1-b4e1-4ca1-a209-c60d989e1675 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=8110296d70974b79a7b8d3847f290990, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.231811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ee8f1-b4e1-4ca1-a209-c60d989e1675 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.303563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a0a3f-2782-45b9-82ff-e3e8c26c8f66 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.326603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.332047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 405/829] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:30 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/8110296d70974b79a7b8d3847f290990/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:15:30.340787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.340787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.340787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.340787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.342574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:30.342574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.342574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.342761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.343029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.343239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.360296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 425/830] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:30.361866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.382694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:30.384294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:30.423773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.473031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 406/831] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:30.493711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.507497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cb271-11be-4148-ac15-e118455aad00 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.554765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.557698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.557698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.557698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.568755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.569459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:30.585421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:30.586580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:30.587674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 426/832] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:30.594062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.618165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1704d4-de2b-497d-aaae-70c1b9e69d46 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.652582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.654692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.655486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.655761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.656142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.668043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:30.676367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:30.677368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:30.678233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 407/833] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:30.683863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.721436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a37fa-6648-4697-9a44-e7b2a2d4f669 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.723178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.757799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.758376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.758652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.758922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.760353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:30.760695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.762206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.780760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 427/834] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:30.782888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.817013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e2bde-1974-4abf-8a18-276940b381a5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.855091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.855838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.856404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.856647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.857487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:30.857864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.859483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.874384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 408/835] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:30.875539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:30.908896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303a1f0-25cf-4c79-b2e4-10239302a2d6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:30.911805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:30.953342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:30.954011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:30.954429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:30.954713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:30.955550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=7be4c89082ac47d786cf7e1821ed01b3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:30.956346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:30.958094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:30.968848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 428/836] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/role_assignments?user.id=7be4c89082ac47d786cf7e1821ed01b3&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:30.989129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:31.013984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f860e-4936-40cc-a352-51ce9565cc4e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.085918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.087853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.088685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.089478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.112023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.115368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9acc76ef-e663-4ae5-8824-6cc5923fd4c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:31.149777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:31.151532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:31.154055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:31.154055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:31.154055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:31.154055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:31.154055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 409/837] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:31.159795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.270003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438da6d8-3136-404e-bfc7-55f787da6a95 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.288797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8576a-c8f0-4616-9ac6-df0454aee6c9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.289291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8576a-c8f0-4616-9ac6-df0454aee6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.289368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8576a-c8f0-4616-9ac6-df0454aee6c9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.290974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 410/838] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:15:31.296324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.296628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.296914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.310136 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.311087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.311563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.312025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.312951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:31.313434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.314631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:31.315180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:31.315796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:31.329291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 429/839] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:31.334661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.363229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:31.412788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 411/840] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:31.431123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.457063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abba15-5082-42f6-9f04-68d9980bb926 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.500578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.502503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.502991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.503727 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.505757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:31.515966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.518173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:31.536184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:31.537163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 20:15:31.538087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:31.548441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 430/841] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:31.549176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.550194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335047d5-85a5-4378-9a6a-e9ef601a7710 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.593223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.594741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.595302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.595755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.596697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.599207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:31.613977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:31.615012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:31.615855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:31.620656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 412/842] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:31.626413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.657497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:31.676555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd17c8-9ac7-4185-8b73-74401cc4d06f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.725277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.726340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.727001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.727905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.729300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:31.729792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.732082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:31.751495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb404dad-3488-4b61-a8cd-ead4f4921b31 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.757709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 431/843] 10.222.0.65 () {56 vars in 1135 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:31.758671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.794926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.796718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.797181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.797630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.798511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:31.799016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.800559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:31.802367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:31.813790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 413/844] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:31.815438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:31.874962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb164ca6-b3a1-4330-9dfd-16cb3a1175de None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.916647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.917567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.917878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.918228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.938681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:31.948993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf4c17-2efa-403f-a049-e1984f7a489a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:31.986025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:31.987140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:31.987499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:31.987847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:31.988647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:31.989030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:31.990901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:32.004652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 414/845] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:32.012523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:32.014041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:32.125649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 432/846] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:15:32.131342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.225582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:32.256459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55683dfc-d6d9-4f2e-86ce-752b008561be None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:32.292927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:32.293721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.294266 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.294587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.305213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:32.306684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:32.325671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:32.326592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:32.327941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:32.327941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:32.327941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:32.327941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:32.327941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 415/847] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:32.332882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.380354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:32.435869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5786c10-02b9-4460-8203-606fe0530e7d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:32.470960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:32.471678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.471970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.472249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.473019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:32.473335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:32.474781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb239-c4b3-4f10-aa15-9e0c0fcdb9d4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:32.489615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 433/848] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:32.495462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.557869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e21b-6ea9-4701-b501-8669238a33b4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.558168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e21b-6ea9-4701-b501-8669238a33b4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.558737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e21b-6ea9-4701-b501-8669238a33b4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.560945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 434/849] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:32.566863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.567143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.567422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.584336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:32.585549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:32.630730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a4f70b-6be6-496b-8969-d9d5392b1826 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:32.647596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:32.659287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 435/850] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:32.669922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:32.670942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.674011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.674011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.678878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:32.680490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:32.684042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:32.697927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:32.698882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:32.699782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:32.704113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 416/851] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:32.705102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.726682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:32.798554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18865d-750d-4489-9f7e-78b4539a406a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:32.805301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e18cf-cc72-48c2-850f-b61f37d70cd7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:32.836051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:32.837306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.837837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.838354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.839928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:32.840581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:32.840893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:32.841253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:32.841950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:32.842257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:32.843669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:32.851134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:32.859295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:32.860268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:15:32.861141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:32.861776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 417/852] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:32.861776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.865021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 436/853] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:32.871656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:32.912990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:32.966092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d237e95-645d-44cc-a4e5-a125f0d85224 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:32.972546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:32.979993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5c48c-a961-471a-831d-1418c506681e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.000808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.001492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.001772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.002048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.002890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=a73a2387e0164fc7936ae83eb81b818f) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:33.003199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.004629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.017045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 418/854] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/role_assignments?user.id=a73a2387e0164fc7936ae83eb81b818f&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:33.019625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.020666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.021183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.021667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.022660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:33.023188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.024879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.036036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 437/855] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:15:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:33.047590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.153610 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:33.158051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb2ee5-ef83-4b98-b4bb-40e90766242f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.194410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.195134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.195412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.195683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.206673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.208132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-7a3ca5d3-ccd7-4bb3-b7c9-c1b2a1b292e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:33.227264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:33.228293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:33.229312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:33.229312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:33.229312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:33.229312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:33.229312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 419/856] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:33.234705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.292499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261c4f-83a7-4e07-a0a8-3d1067562780 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.292844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261c4f-83a7-4e07-a0a8-3d1067562780 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.293118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11261c4f-83a7-4e07-a0a8-3d1067562780 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.295011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 420/857] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:33.299734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.300025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.300310 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.318303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:33.319489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:33.356262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de62399-4317-41fe-b8ac-f8877a08e79c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.392073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 421/858] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:33.398825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.399728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.400273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.400792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.401746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:33.402258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.403821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.415027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.420471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 438/859] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:33.426011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.453095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:33.519286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:33.547206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6db736-7993-4798-b938-da426cf8cca3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.547509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc06a072-a42c-4e8a-8826-21721bcac72a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.596313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.597690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.597966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.598237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.598904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.600267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.603128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.603944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.604227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.604521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.614999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.616435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:33.622286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:33.623205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:33.624035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:33.626951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 422/860] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:33.632240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:33.633233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:33.634173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:33.635749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:33.643968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 439/861] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:33.644708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.726469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:33.744116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c93e6-088d-48c5-84ba-5e70d04be726 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.749232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14ecc1-7724-4124-824c-74e3f0754760 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.781757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.782949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.783516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.783944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.784933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.785081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:33.785512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.785872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.786259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.786637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.787487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.787665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:33.788219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.789763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.794419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 423/862] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:33.799798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.811261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:33.818268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 440/863] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:33.819326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:33.911375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb29403-5d6d-4ae1-ac50-008f41219716 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.927267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71ffbf-0f5a-436d-987e-57cbfce9d5b0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:33.949326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.950348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.950848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.951319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.952356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:33.952900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:33.954599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:33.960040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 424/864] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:33.968159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f565349-1282-44fb-a14f-e8449cb9ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:33.969263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565349-1282-44fb-a14f-e8449cb9ec19 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:33.969774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565349-1282-44fb-a14f-e8449cb9ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:33.970248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565349-1282-44fb-a14f-e8449cb9ec19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:33.973642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:34.044739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f565349-1282-44fb-a14f-e8449cb9ec19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:34.046580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f565349-1282-44fb-a14f-e8449cb9ec19 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:34.157299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 441/865] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:15:34.163221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:34.193042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06c572-d2f1-452c-8b65-c6bc6e0f6a7c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.193576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06c572-d2f1-452c-8b65-c6bc6e0f6a7c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.193856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f06c572-d2f1-452c-8b65-c6bc6e0f6a7c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.195235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 442/866] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:34.201401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.201679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.201979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.220688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:34.221912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:34.253702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:34.256071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:34.286630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b0ef-d020-4033-95e0-fe62a8298d7b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:34.303408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 443/867] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:34.326434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:34.331189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:34.332006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.332270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.332550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.345103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:34.346645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:34.367026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:34.367969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:34.369206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:34.369206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:34.369206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:34.369206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:34.369206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 425/868] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:34.374064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:34.441640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1fbfa-3ff6-4e51-b4cd-88eba4a5bb3c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:34.477692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:34.478997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.479285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.479565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.480308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:34.481719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:34.498426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877e2d-8bff-4c75-a338-0d678040f660 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:34.522929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:34.533499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:34.534155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.534437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.534710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.535448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:34.535843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:34.537161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:34.561645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 426/869] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:34.562230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 444/870] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:34 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:34.564004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:34.675085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4bf59-4dad-480a-8df3-d28f6de8670a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:34.718941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:34.720056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.720548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.721031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.733342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:34.734804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:34.749600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:34.750568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:34.751723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 427/871] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:34.758828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:34.790927 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:34.869792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195809cb-c76e-4e1d-9e95-3a76d551060a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:34.904390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:34.905451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:34.905932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:34.906469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:34.907481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:34.907986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:34.909623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c71a60-1b9a-42ac-9509-c199f64fb12e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:34.922093 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 445/872] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:34.928224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:34.972433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:35.031638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27066e-84d5-4a20-a4d5-0db76ed7ebc3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:35.066497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:35.067378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:35.067805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:35.068246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:35.069259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=8110296d70974b79a7b8d3847f290990) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:35.069715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:35.071265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79195c68-5e8c-4a5c-8bff-fe11facfe340 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:35.078414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 428/873] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:34 2022] GET /identity/v3/role_assignments?user.id=8110296d70974b79a7b8d3847f290990&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:35.300808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724eef-5261-434c-889a-a30c2562faad None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:35.301304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724eef-5261-434c-889a-a30c2562faad None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:35.301700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724eef-5261-434c-889a-a30c2562faad None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:35.303415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 446/874] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:35.308817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:35.309112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:35.309398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:35.326954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:35.328137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:35.399143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 429/875] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:35.422321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724eef-5261-434c-889a-a30c2562faad None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:35.509969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:35.529291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724eef-5261-434c-889a-a30c2562faad None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:35.566822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:35.567557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:35.567841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:35.568116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:35.568799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:35.570165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:35.583040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:35.584029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:35.585524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 447/876] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:35.590322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:35.625794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:35.698877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b95297-abad-40ce-84c0-3c34d99d9678 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:35.736273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:35.736967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:35.737253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:35.737532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:35.738246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:35.738557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:35.739921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365f09d-8b17-48a7-84bc-01a610490ab0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:35.745767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 430/877] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:35.753713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:35.861625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5c2d8-145e-42b7-b336-28cc132260ae None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:35.897713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:35.898392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:35.898681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:35.898962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:35.899681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:35.900055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:35.901939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8003d5-439a-4061-af77-033f5f53120b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:35.907489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 448/878] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:36.310111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853e77-97a4-4b99-bfaf-5cddd3817a38 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:36.310846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853e77-97a4-4b99-bfaf-5cddd3817a38 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:36.311343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83853e77-97a4-4b99-bfaf-5cddd3817a38 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:36.313220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 431/879] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:36.318564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75b9e-9dfd-4367-a0da-4990f328b539 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:36.319077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75b9e-9dfd-4367-a0da-4990f328b539 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:36.319551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d75b9e-9dfd-4367-a0da-4990f328b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:36.337557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-09d75b9e-9dfd-4367-a0da-4990f328b539 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:36.339050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-09d75b9e-9dfd-4367-a0da-4990f328b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:36.347633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:36.410658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 449/880] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:36.435656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83853e77-97a4-4b99-bfaf-5cddd3817a38 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:36.541681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:36.548630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83853e77-97a4-4b99-bfaf-5cddd3817a38 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:36.581152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e6a82f-9416-46a3-89d3-867a88603dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:36.581720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6a82f-9416-46a3-89d3-867a88603dd8 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:36.582004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6a82f-9416-46a3-89d3-867a88603dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:36.582278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e6a82f-9416-46a3-89d3-867a88603dd8 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:36.583006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6a82f-9416-46a3-89d3-867a88603dd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:36.584366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e6a82f-9416-46a3-89d3-867a88603dd8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:36.629146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 432/881] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:36 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:36.853540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1251-696d-44c6-b724-97872a1428da None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:36.854049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1251-696d-44c6-b724-97872a1428da None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:36.854049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be1251-696d-44c6-b724-97872a1428da None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:36.855595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 450/882] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:36.860876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:36.861173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:36.861457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:36.879717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:36.880940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:36.957048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 433/883] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:36.979591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1251-696d-44c6-b724-97872a1428da None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.088449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be1251-696d-44c6-b724-97872a1428da None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.124242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.124999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.125282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.125559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.126222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:37.127607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:37.139864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:37.140959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:37.142212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 451/884] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:37.147186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.235398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:37.250981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdea0ea-d937-4468-b072-d36ff241f389 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.286203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.286896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.287178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.287456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.288197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:37.288509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:37.290072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d72ac08-0dfd-455d-9d13-a0bc293464d9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:37.298001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 434/885] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:37.303440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.313694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:37.350591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8326d51-0a29-488f-a20b-391adc80e294 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.350928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8326d51-0a29-488f-a20b-391adc80e294 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.351163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8326d51-0a29-488f-a20b-391adc80e294 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.353368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 435/886] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:37.359116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.359403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.359685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.377564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:37.379144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:37.415339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8d094-b848-4923-9f98-859583bb61cb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.452258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.453249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.453728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.454170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.455045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:37.455604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:37.456968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 436/887] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:37.457736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:37.464123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 452/888] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:37.469938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.479761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.553174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:37.563486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:37.586437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0a4f-6d6d-41b4-b6a3-29f2567ed734 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.590192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fd2cc-ab6a-43c2-8f0f-a9c8064f9792 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.625831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.626325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.626919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.627726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.628256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.628524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.629286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.629728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.630102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] RBAC: Adding query filter params (interface=public, service_id=c2b3cc62975d49229281eefc0b0f7e33, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:37.630626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:37.632296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:37.645312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 437/889] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/endpoints?service_id=c2b3cc62975d49229281eefc0b0f7e33&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:37.645490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:37.646304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:37.655947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:37.656942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:37.657771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:37.660687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 453/890] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:37.664259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.779433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10631a95-d7b5-4111-a522-0a12ca633153 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.794253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a858a-81c4-4635-8338-53323af83688 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:37.825528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.826759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.827464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.827919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.829336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:37.830913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:37.832314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:37.836895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:37.838162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:37.838505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:37.838788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:37.839542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:37.844756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:37.844756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:37.845242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 438/891] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/services => generated 1268 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:15:37.856764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 454/892] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:37.862324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:37.873615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:37.981456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb190c6-9a57-4366-9de6-a23122591e10 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:38.021250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:38.022045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.022328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.022604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.033751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:38.035200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e659da8f-8d0c-41f1-a2f6-d6e7cc545103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:38.053537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:38.054479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:38.055375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:38.055375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:38.055375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:38.055375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:38.055375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 439/893] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:38.060764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:38.169232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a2547-1fa0-4d90-9442-7a5e360653af None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.170175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a2547-1fa0-4d90-9442-7a5e360653af None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.170947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a2547-1fa0-4d90-9442-7a5e360653af None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.172552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fa23c-ec6e-4e11-bf19-e53df13bd739 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:38.172988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 440/894] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:15:38.178148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.178657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.179134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.196956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:38.198462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:38.210403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:38.211064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.211345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.211616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.212550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:38.213020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:38.214486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:38.226506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 455/895] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:38.237777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:38.274034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:38.300966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 441/896] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:38.301614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:38.319429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:38.363409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6c4ac-6579-4ca5-bb16-a9c039e985f3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:38.404535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:38.405621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.406054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.406479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.414683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:38.416931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:38.433175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:38.434159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:38.435090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:38.437749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 456/897] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:15:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:38.437859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590075c-ceab-46ab-a96e-96cdef81a848 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:38.443236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:38.480858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:38.481533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.481796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.482068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.483092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:38.484629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:38.563966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c83979-a8d0-49ca-ac9b-2b63e6f8d8ce None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:38.569097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 442/898] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:38 2022] POST /identity/v3/services => generated 241 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:38.581914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:38.613332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:38.614335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.614802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.615285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.616356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:38.616899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:38.619151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4344d-4ba0-420b-9fd6-cb4aa80ae703 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:38.640196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 457/899] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Jun 16 20:15:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:38.645898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:38.702095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:38.764478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480781a4-75d3-4dda-86a7-c655deae8917 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:38.810855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:38.811448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.811729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.812003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.857975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5e70-6443-4a37-86f7-cb2b934607bb None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.858587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5e70-6443-4a37-86f7-cb2b934607bb None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.858880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5e70-6443-4a37-86f7-cb2b934607bb None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.861087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 458/900] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:38.870276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:38.870695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:38.871644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:38.892327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:38.892879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:38.893533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:38.894340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:38.963786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:38.969205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 459/901] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:38.997159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.037523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 443/902] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:38 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:15:39.043151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.103875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:39.110504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940502b3-bc1c-4d4a-8866-b446b42cbd45 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.146541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.147720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.148201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.148730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.149929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.151532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.156024 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57b045-3b09-4660-9df0-83c74d8a3f2b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:39.166423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:39.167351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:39.168177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:39.170914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 460/903] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Jun 16 20:15:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:39.176658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.191937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.192764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.193046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.193322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.204345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.205831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.214978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:39.229217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:39.253802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:39.255143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:39.255143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:39.255143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:39.255143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:39.255143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 444/904] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:39.255143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.311355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1d0eb-2d93-477c-aba9-061f9507a52e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.348281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.349148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.349536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.349919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.350745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:39.351160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.352685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.358240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 461/905] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:39.363407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.375244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2f380-4e21-47d5-844f-9c09c1a511d2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.390328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:39.411533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.412372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.412806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.413177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.414001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:39.414407 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.415952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.429353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 445/906] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:39.435179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.476961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94330b2-4f9a-4d4f-afe1-6264040bed1f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.514013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.515039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.515553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.516051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.517027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:39.517285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:39.518469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.520038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.526280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 462/907] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:39.534244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.566904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faf436-3cec-400e-8d9a-46d31140c100 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.618156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.618901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.619158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.619485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.631361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.633142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:39.633499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.651139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e0f8a-f595-4d82-aa01-6905dc779db7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:39.651931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:39.653100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:39.654738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 446/908] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:39.658783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.708975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.711122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.711807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.713046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.714459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] RBAC: Adding query filter params (interface=public, service_id=073d8b3bba2544e48b76059d32d14cae, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:39.715035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.717730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.727538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 463/909] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/endpoints?service_id=073d8b3bba2544e48b76059d32d14cae&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:39.736665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.774129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e30b-bd95-46f5-bcc1-29899436a1d2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.798233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:39.812808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.813506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.814009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.814138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.814852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:39.815155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.816651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.834673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 447/910] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:39.835836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:39.877225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f3ff4-fb11-4cf1-abdd-74a7856abaa1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.926651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26a153-38f1-46d2-b075-d7bbb51646e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.927902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a153-38f1-46d2-b075-d7bbb51646e5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.928381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a153-38f1-46d2-b075-d7bbb51646e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.928995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26a153-38f1-46d2-b075-d7bbb51646e5 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.930183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26a153-38f1-46d2-b075-d7bbb51646e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.931778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26a153-38f1-46d2-b075-d7bbb51646e5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:39.949107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 464/911] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:15:39.953561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa412fa-1871-438a-8803-f2df95f57f3c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:39.993816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:39.994505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:39.994788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:39.995060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:39.995935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] RBAC: Adding query filter params (role.id=03b5dc906c2e4d389709e9bf5104ffae, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=8110296d70974b79a7b8d3847f290990) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:39.996250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:39.997798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1923bbc-2207-4ecb-8148-d6ea0ffcebe5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:40.005258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 448/912] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:39 2022] GET /identity/v3/role_assignments?user.id=8110296d70974b79a7b8d3847f290990&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=03b5dc906c2e4d389709e9bf5104ffae => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:40.073724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b493d-791a-401d-aaab-ff3447547fde None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.074097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b493d-791a-401d-aaab-ff3447547fde None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.074284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b493d-791a-401d-aaab-ff3447547fde None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:40.076095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 465/913] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:40.081654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.081965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.082212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:40.101941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:40.103225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:40.152097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:40.182183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 449/914] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:40.206857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b493d-791a-401d-aaab-ff3447547fde None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:40.226325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:40.313754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b493d-791a-401d-aaab-ff3447547fde None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:40.354152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:40.354955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.355241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.355521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:40.356182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:40.357581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:40.370366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:40.371451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:40.372338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 466/915] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:40.377484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:40.481751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e18ce-07c4-4512-a0be-1c129b8fc1ac None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:40.518662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:40.519325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.519594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.519864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:40.520570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:40.520901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:40.522249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:40.529044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 450/916] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:40.534625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:40.621865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:40.641006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48bc7-d4fc-4371-8639-182323cb3acd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:40.674742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:40.675400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.675680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.675953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:40.676690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:40.677001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:40.678398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff73b0-3f5b-4c40-94d5-63f26fa3f966 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:40.684605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 467/917] 10.222.0.65 () {56 vars in 1114 bytes} [Thu Jun 16 20:15:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:40.690182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:40.732291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:40.793873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94cad0-5895-4ca0-8114-d8c43b0c3876 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:40.833464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4af2-0c9a-476e-abf4-b784b3f6cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:40.834120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4af2-0c9a-476e-abf4-b784b3f6cd3f None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.834404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4af2-0c9a-476e-abf4-b784b3f6cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.834676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4af2-0c9a-476e-abf4-b784b3f6cd3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:40.835432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4af2-0c9a-476e-abf4-b784b3f6cd3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:40.837355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4af2-0c9a-476e-abf4-b784b3f6cd3f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:40.936575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 451/918] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:40.997915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a062-1f2c-463f-92ac-108f92a3faa2 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:40.998479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a062-1f2c-463f-92ac-108f92a3faa2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:40.998479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a062-1f2c-463f-92ac-108f92a3faa2 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.000009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 468/919] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:41.005709 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:41.006328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:41.006830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.027598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:41.029368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:41.124638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 452/920] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:41.141326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a062-1f2c-463f-92ac-108f92a3faa2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:41.257509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a062-1f2c-463f-92ac-108f92a3faa2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:41.294766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:41.295575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:41.295861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:41.296140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.296820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:41.298254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:41.311130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:41.312178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:41.313452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:41.316736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 469/921] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:41.322258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:41.344374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:41.424752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635977c-12c4-4e71-89b3-d6f25e8f4551 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:41.459475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:41.460143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:41.460510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:41.460842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.461602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:41.462486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:41.463852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:41.468924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 453/922] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:41.474599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:41.486315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:41.581070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf6e7b-e136-4435-a082-64908bd1eb40 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:41.615348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:41.616016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:41.616299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:41.616574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.617321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:41.617628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:41.619538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:41.624892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 470/923] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:41.634012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:41.719242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:41.734684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5d5c-e08e-4c0e-b2bc-d6ee81ceb8b9 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:41.774439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:41.775161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:41.775662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:41.776124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.776962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] RBAC: Adding query filter params (interface=public, service_id=4d339b1162d04509a60b5ea15395e092, region_id=RegionOne) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:41.777274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:41.778646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86116cb9-8694-4250-abc8-cf7806f07a61 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:41.784355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 454/924] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:41 2022] GET /identity/v3/endpoints?service_id=4d339b1162d04509a60b5ea15395e092&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:41.789840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:41.865108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:41.896472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b949f-a6c6-47f9-ab91-ee0780801d4a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:41.932224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33c5c-4729-4431-96c6-e19e0b1c49ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:41.932936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33c5c-4729-4431-96c6-e19e0b1c49ce None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:41.933221 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33c5c-4729-4431-96c6-e19e0b1c49ce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:41.933501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33c5c-4729-4431-96c6-e19e0b1c49ce None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:41.934248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33c5c-4729-4431-96c6-e19e0b1c49ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:41.935667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33c5c-4729-4431-96c6-e19e0b1c49ce None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:41.942240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 471/925] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:41 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:15:42.338031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60b8de-fdaf-4402-a177-91cc67b20c74 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.338431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60b8de-fdaf-4402-a177-91cc67b20c74 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.338639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60b8de-fdaf-4402-a177-91cc67b20c74 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.340250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 455/926] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:42.342728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f3fc-a3f8-4d89-91c8-8142017ccf14 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.343281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f3fc-a3f8-4d89-91c8-8142017ccf14 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.343281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92f3fc-a3f8-4d89-91c8-8142017ccf14 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.344786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 472/927] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:42.348704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.348998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.349274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.351725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.352036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.352879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.371308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:42.372591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:42.373168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:42.374621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:42.455409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 473/928] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:42.458285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 456/929] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:42.482321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:42.482729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:42.569647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:42.597787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:42.610114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25685aa2-0a8e-47fb-9f0e-3ac68f02078a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:42.625091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb14e1-164a-4c86-a1ca-26a8aa110d68 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:42.652502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:42.654090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.654905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.655518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.666612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:42.667727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.668283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.668564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.669268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:42.670638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:42.672884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:42.682236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:42.683387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:42.684548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:42.685487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:42.688047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:42.690825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 457/930] 10.222.0.65 () {56 vars in 1132 bytes} [Thu Jun 16 20:15:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:42.693454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:42.701270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 474/931] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Jun 16 20:15:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:42.704307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:42.817326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0e826-74e2-47f1-b943-1127c69b3113 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:42.829407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b4ebf-e1e7-4bbb-ac9b-fd8160d3f8d7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:42.860386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:42.861011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.861299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.861484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:42.861586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.862492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:42.862643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:42.864434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:42.873611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:42.874744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:42.875285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 458/932] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:42.875577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:42.876060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:42.876164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:42.877167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:42.877849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:42.880042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:42.886479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:42.898235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 475/933] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:15:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:42.900520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:42.997505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfd51b-0de8-4f41-9d49-f61796b29ffe None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.027559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b1be8-2488-476e-8788-fc4dc744658e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.037733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.038866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.039356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.040168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.041429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:43.041956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.043987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.051035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 459/934] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:43.057500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.074548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.075415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.075723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.075989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.089468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.091408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:43.114475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:43.115756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:43.117267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:43.117267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:43.117267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:43.117267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:43.120900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 476/935] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:43.121965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.158048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:43.179787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:43.197162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc02a99-e34c-4c22-9f70-489fc9e92bc1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.234027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9109c64-6299-4765-a03f-c20e3264f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.234680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9109c64-6299-4765-a03f-c20e3264f9a0 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.234965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9109c64-6299-4765-a03f-c20e3264f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.235243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9109c64-6299-4765-a03f-c20e3264f9a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.235988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9109c64-6299-4765-a03f-c20e3264f9a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.237375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9109c64-6299-4765-a03f-c20e3264f9a0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.249379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548a68e-7f28-416e-9c0e-ba8ec998a629 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.284586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.285277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.285587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.285870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.286592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:43.286900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.288253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03048b8e-75d8-49d8-80d2-bd4030334594 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.300199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 477/936] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:43.301516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415ec0-22b1-4d20-b530-765f2b6856bc None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.301796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415ec0-22b1-4d20-b530-765f2b6856bc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.302074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415ec0-22b1-4d20-b530-765f2b6856bc None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.303481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 478/937] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:43.305569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a415ec0-22b1-4d20-b530-765f2b6856bc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.319946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 460/938] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:43.321596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.321976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.322426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.340965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:43.342418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:43.441681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a415ec0-22b1-4d20-b530-765f2b6856bc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.446202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 461/939] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:43.449492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:43.465392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.487116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.487953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.488233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.488508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.499440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.501256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:43.520141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:43.521301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:43.522256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:43.522813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 479/940] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:43.530140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.533019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:43.608251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedfa8c-bbd7-4a7a-a6ae-1ccdff60b191 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.647058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a046cc2-0443-469b-b023-507fec8d68fb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.653989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.654659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.654944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.655221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.655938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.657984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.660268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING keystone.server.flask.common [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 20:15:43.687903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.696208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.696208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.696208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.696208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:43.696208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.696208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.710034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 480/941] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:43.715373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.721660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.sql.core [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 20:15:43.721660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 20:15:43.721660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [parameters: {'id': 'c377f64a2a7046ed894302943c8a6b86', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 20:15:43.721660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80421) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c377f64a2a7046ed894302943c8a6b86.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c377f64a2a7046ed894302943c8a6b86. Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:15:43.738605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result.read() Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 20:15:43.739522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application yield resource Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise self.value Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application session.commit() Jun 16 20:15:43.740526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.session.flush() Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application compat.raise_( Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 20:15:43.741504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 20:15:43.742443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application result.read() Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:15:43.743314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [parameters: {'id': 'c377f64a2a7046ed894302943c8a6b86', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.744181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:43.749972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c377f64a2a7046ed894302943c8a6b86. Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 462/942] 10.222.0.65 () {60 vars in 1140 bytes} [Thu Jun 16 20:15:43 2022] POST /identity/v3/projects => generated 262 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:43.750903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.756410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:43.843743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0bae-a3a8-4f25-92ed-bf92e35b1c05 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.864637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd3343-ade5-493f-8451-eb2a1b98ec59 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:43.880408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.881095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:43.881735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.882213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.882713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.894917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.901687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.907666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:43.908474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:43.908769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:43.909053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:43.915983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:43.916911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:43.917778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:43.917778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:43.917778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:43.917778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:43.918285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:43.918285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:43.924897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 481/943] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:43.926123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:43.935194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:43.936112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:43.937039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 463/944] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:43.942282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.001032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.033524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f42dd0-9f6a-4a43-b700-606d3030c06e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.057297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a971ca7-8c69-4cf0-9fb4-7b23724a3beb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.072047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.073196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.073686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.074161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.075118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:44.075656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.077295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.095476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 482/945] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:44.096687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.098665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.099376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.099666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.099944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.100919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:44.101234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.102822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3b2c-ce26-409d-8a23-5a9ba25a243f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.125560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 464/946] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:43 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:44.127119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63705c-14cc-4eed-bd1b-cf6b69c7c899 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.127410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63705c-14cc-4eed-bd1b-cf6b69c7c899 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.127695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f63705c-14cc-4eed-bd1b-cf6b69c7c899 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.128981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 465/947] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:44.135581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d1dd-0856-4255-934d-099544d29162 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.135929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d1dd-0856-4255-934d-099544d29162 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.136151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d1dd-0856-4255-934d-099544d29162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.154419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f735d1dd-0856-4255-934d-099544d29162 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:44.156022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f735d1dd-0856-4255-934d-099544d29162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:44.184174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.219745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0a9d8-57ad-42db-b771-de300977b526 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.255982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.260766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 466/948] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:44.269037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.270213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.270698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.271256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.279237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.281224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.284030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d1dd-0856-4255-934d-099544d29162 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:44.303611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:44.304580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:44.305584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:44.306004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 483/949] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:44.311288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.400234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d1dd-0856-4255-934d-099544d29162 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.422303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d4363-cf7f-4e8f-9714-09e120256602 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.441320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.442136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.444082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.444082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.444082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.444772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:44.457315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:44.458994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:44.461386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:44.462784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.462784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.463484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.463601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.463725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 467/950] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:44.466790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:44.466790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.467234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.467424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.483651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 484/951] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:44.494329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.494924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.569917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.594166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be95ea5-11f5-480f-a01b-4060930fdfe7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.629246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ed1f6-2c65-4126-98ba-982a999af9b1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.632132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.633005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.633459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.633875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.634734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:44.635187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.636738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.642741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 468/952] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:44.649829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.676552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.677653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.677943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.678235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/8110296d70974b79a7b8d3847f290990/roles/03b5dc906c2e4d389709e9bf5104ffae` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.683317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=8110296d70974b79a7b8d3847f290990, role_id=03b5dc906c2e4d389709e9bf5104ffae)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.685668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.749262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 485/953] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:15:44 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/8110296d70974b79a7b8d3847f290990/roles/03b5dc906c2e4d389709e9bf5104ffae => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:15:44.763143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.778205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbce0-fd10-4c25-91f2-c2bb1d3614bf None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.822754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.823413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.823702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.823980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.824824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:44.825137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.826708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7c6c9-16ed-4333-9110-e1a7ed215d63 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:44.836813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 469/954] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:44.839920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:44.952229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de35fcc-d48f-4112-a65d-dadaa28f29f3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:44.965304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:44.989703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4b16e-c5e6-4351-961e-534d5dd2a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:44.990368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4b16e-c5e6-4351-961e-534d5dd2a249 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:44.990654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4b16e-c5e6-4351-961e-534d5dd2a249 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:44.990934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4b16e-c5e6-4351-961e-534d5dd2a249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:44.991711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4b16e-c5e6-4351-961e-534d5dd2a249 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:44.993512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4b16e-c5e6-4351-961e-534d5dd2a249 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:45.108877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 486/955] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:45.653854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda77e65-66dd-431a-aeed-902f6e36605f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:45.654186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda77e65-66dd-431a-aeed-902f6e36605f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:45.654424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda77e65-66dd-431a-aeed-902f6e36605f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:45.656126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 470/956] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:45.661279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:45.661734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:45.661901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:45.678721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:45.679937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:45.755020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 487/957] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:45.778329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda77e65-66dd-431a-aeed-902f6e36605f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:45.888712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda77e65-66dd-431a-aeed-902f6e36605f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:45.923730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:45.924829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:45.925279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:45.925716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] PATH_INFO: `/v3/services/compute` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:45.926528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:45.928085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:45.940965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:45.942386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:45.943454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:45.946593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 471/958] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:45.952272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:46.053320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:46.062330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922db22-6d37-4175-ab75-67ba3101e902 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:46.100021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:46.100840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:46.101387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:46.101768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:46.102840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] RBAC: Adding query filter params (name=compute) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:46.103147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:46.104492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150ae6f-68f7-4566-bfc0-73c105ff3ced None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:46.109961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 488/959] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:46.115442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:46.134637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:46.230023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ef256-672d-422a-a120-c737911ab0ff None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:46.265862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:46.266841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:46.267276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:46.267721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:46.268598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:46.269102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:46.270608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55104b-e3e5-4d98-a856-d5bfaf6ebedb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:46.275790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 472/960] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:46.393272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c8c5-d666-4059-8a8b-c783d460b52c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:46.393561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c8c5-d666-4059-8a8b-c783d460b52c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:46.393844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303c8c5-d666-4059-8a8b-c783d460b52c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:46.395491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 489/961] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:46.401278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:46.407085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:46.407085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:46.420251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:46.421498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:46.492889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 473/962] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:46.517551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c8c5-d666-4059-8a8b-c783d460b52c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:46.646275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303c8c5-d666-4059-8a8b-c783d460b52c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:46.683720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:46.684485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:46.684757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:46.685195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:46.685913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:46.687330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:46.688719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING keystone.server.flask.common [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 20:15:46.729709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.sql.core [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 20:15:46.729709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 20:15:46.729709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [parameters: {'user_id': '5bafc75da4a34347b25a8cef2c81e4e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 20:15:46.729709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80422) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result.read() Jun 16 20:15:46.737217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:15:46.738109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application yield resource Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application next(self.gen) Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise self.value Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application session.commit() Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 20:15:46.739077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.session.flush() Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application compat.raise_( Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 20:15:46.739983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 20:15:46.741918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application conn.query(q) Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application result.read() Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 20:15:46.744598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [parameters: {'user_id': '5bafc75da4a34347b25a8cef2c81e4e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:46.746711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 20:15:46.748737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:46.750949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 490/963] 10.222.0.65 () {60 vars in 1131 bytes} [Thu Jun 16 20:15:46 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:46.751909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:46.761046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:46.859198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb3e1e-f19f-405c-b7bd-1da0f42a1cb1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:46.896644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:46.897466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:46.897889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:46.898167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:46.906219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:46.907660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1a34442e-5b40-43a2-a126-349fb1202908 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:46.923408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:46.924372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:46.925468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 474/964] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:46.930670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:46.954594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.044405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5934ff-db79-4833-8871-c55ef7a17751 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.070949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001e61d-cc6f-4e3c-b3b1-7eb3991ace14 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.071235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001e61d-cc6f-4e3c-b3b1-7eb3991ace14 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.071510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001e61d-cc6f-4e3c-b3b1-7eb3991ace14 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.073159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 475/965] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:47.078191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.078478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.078760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.079398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.080072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.080351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.080652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.081460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:47.081763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:47.083377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:47.097267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:47.098797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:47.128654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 491/966] 10.222.0.65 () {56 vars in 1101 bytes} [Thu Jun 16 20:15:46 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:47.174046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.180473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 476/967] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:47.204443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.289455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.313922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70e30c-12c3-4500-b87a-3610fed24b1b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.350517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fb8c2-64c0-496b-9243-f48f8caae46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.351386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb8c2-64c0-496b-9243-f48f8caae46c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.352224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb8c2-64c0-496b-9243-f48f8caae46c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.352500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb8c2-64c0-496b-9243-f48f8caae46c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.363180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fb8c2-64c0-496b-9243-f48f8caae46c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-fb4fb8c2-64c0-496b-9243-f48f8caae46c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:47.371471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:47.372467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:47.373377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 492/968] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:47.379393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.495198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea85b4-72a3-4398-a7ee-d94817789f71 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.513209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bf5eb-2384-47f1-b45e-405179c58f5d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.513495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bf5eb-2384-47f1-b45e-405179c58f5d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.513773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bf5eb-2384-47f1-b45e-405179c58f5d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.515148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 493/969] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:15:47.520164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.520454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.520763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.530160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.530832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.531114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.531390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.532149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:47.532455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:47.533843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:47.539830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:47.541391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:47.545118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 477/970] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:47.550279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.615932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.617693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 494/971] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:47.640019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.663195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0ae8a-8300-49d5-b68b-06d44944083c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.703886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.704708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.704994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.705268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.706332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.716476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:47.717874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:47.735170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:47.736098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:47.737044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:47.737044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:47.737044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:47.737044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:47.737044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 478/972] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:47.742841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.744114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ece05-44cd-4d17-85fa-c2d1533a2255 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.779648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.780477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.780797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.781080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.781743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:47.783097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:47.798874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:47.799862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:47.806408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 495/973] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:47.807266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.845763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6d84e-bf10-4732-8b7b-46ffc99c07cd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.858209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.879773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.880400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.880400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.880713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.881441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:47.881749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:47.883645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:47.896373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 479/974] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:47.902084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:47.924275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c38f6-287e-49ae-bd27-2380e6b83948 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:47.955576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:47.961461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:47.962272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:47.962556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:47.962833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:47.963537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:47.963843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:47.965234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:47.974491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 496/975] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:47.975470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.017229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6053-1e4c-4ce5-a950-2bb46b9df490 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.050963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.051773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.052051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.052322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.060024 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.061487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:48.076290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:48.077566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:48.078536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 480/976] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:48.081534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea8ca-e1a6-4979-a270-fe84f4d2ed59 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.083275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.113118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.123890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.124936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.125626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.126138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.127241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:48.127717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.129262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.135042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 497/977] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:48.140569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.190464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb89ba-8f79-4925-93b0-dcaef118fe7d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.202275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.232757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.233837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.234116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.234649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.235437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:48.235751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.237279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.246416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47d9a3-60ff-444b-b60d-3f30231a0594 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.260654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 481/978] 10.222.0.65 () {56 vars in 1149 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:48.262380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.286719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.287531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.287818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.288477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.290339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] RBAC: Adding query filter params (interface=admin, service_id=4d339b1162d04509a60b5ea15395e092, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:48.290892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.293097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.305571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 498/979] 10.222.0.65 () {56 vars in 1249 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/endpoints?service_id=4d339b1162d04509a60b5ea15395e092&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:48.307400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.354859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.365791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b30a2-5fbc-45f5-a011-0affe42c7b2d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.405299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.406233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.406567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.406839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.422014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6be3f3-c792-454a-a623-9cb5f6cfcfb9 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.445723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.457252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08a105-8d0a-440e-86e9-f1cbdc43a1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.458059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a105-8d0a-440e-86e9-f1cbdc43a1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.458343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a105-8d0a-440e-86e9-f1cbdc43a1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.458735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08a105-8d0a-440e-86e9-f1cbdc43a1a8 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.459416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08a105-8d0a-440e-86e9-f1cbdc43a1a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.461336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08a105-8d0a-440e-86e9-f1cbdc43a1a8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.467621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 499/980] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:15:48.493153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.494699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.554480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b91be-147c-4c9f-b8c9-4c23526e4659 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.555652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b91be-147c-4c9f-b8c9-4c23526e4659 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.556165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b91be-147c-4c9f-b8c9-4c23526e4659 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.557872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 500/981] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:15:48.563589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.563888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.564172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.582706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:48.583937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:48.601742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.618221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 482/982] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 20:15:48.620230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.670094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 501/983] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:48.693301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.727290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53357c2-0724-412a-b3ae-f43061b6b8db None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.763798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.764588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.764899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.765174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.777148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.778594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.791867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d72cd-5bf4-499e-b9e7-5619fc724a39 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:48.797463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:48.798377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:48.799305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:48.799305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:48.799305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:48.799305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:48.800931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 483/984] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:48.804244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:48.811310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.830065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.831389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.831706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.831922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.832846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.839772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.849108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:48.903178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0d338-8058-4973-b1ce-ea10ef0e2230 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:48.917336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 502/985] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:48 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:48.950624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:48.951261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:48.951550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:48.951822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:48.952566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:48.952899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:48.954311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:48.967497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 484/986] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:48.973313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:49.087059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e1e09-cca4-4eb1-b1a6-990804fa609b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:49.122078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:49.122889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:49.123172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:49.123450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:49.130460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:49.131910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:49.146376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:49.147437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:49.148938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 503/987] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:49.154200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:49.264774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:49.269793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb987c-1140-4d5e-93fe-b5ffc787f7ba None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:49.308516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:49.309200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:49.309482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:49.309753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:49.310538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:49.310846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:49.312771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706806f3-1360-49f6-afcd-bd8297e717ff None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:49.325108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 485/988] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:49.332086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:49.367641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:49.438682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c4cd-f52d-44d8-aaee-ab6ee8ba9dcb None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:49.515567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:49.516146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:49.516428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:49.516734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:49.517578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] RBAC: Adding query filter params (role.id=03b5dc906c2e4d389709e9bf5104ffae, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=8110296d70974b79a7b8d3847f290990) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:49.517890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:49.519334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238dbd8-2abf-459f-9db5-ebb7e6173e59 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:49.532700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 504/989] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:49 2022] GET /identity/v3/role_assignments?user.id=8110296d70974b79a7b8d3847f290990&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=03b5dc906c2e4d389709e9bf5104ffae => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:50.679148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ea4fa-5446-4db5-a6d9-fa37d6f503bc None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:50.680181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ea4fa-5446-4db5-a6d9-fa37d6f503bc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:50.680378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ea4fa-5446-4db5-a6d9-fa37d6f503bc None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:50.681917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 486/990] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:50.687420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:50.687869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:50.688126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:50.705750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:50.707032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:50.775726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 505/991] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:50.798555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ea4fa-5446-4db5-a6d9-fa37d6f503bc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:50.914230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ea4fa-5446-4db5-a6d9-fa37d6f503bc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:50.947444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:50.948233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:50.948513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:50.948819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:50.949464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:50.950808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b9b09792-8ee1-461a-b4d3-e9f44dd09d13 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:50.962643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:50.963640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 20:15:50.964504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:50.971769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 487/992] 10.222.0.65 () {56 vars in 1126 bytes} [Thu Jun 16 20:15:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:50.971904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.000020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.074704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dbaf2-bfc3-4c82-841a-b4856e9b0bf8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.091374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f808-c206-4fdf-9c94-c2595940d731 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.091689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f808-c206-4fdf-9c94-c2595940d731 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.091952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550f808-c206-4fdf-9c94-c2595940d731 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.093361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 488/993] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:51.098136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.098426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.098704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.111162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.112120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.112591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.113073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.113949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:51.114451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.115576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:51.116279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.116857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:51.121945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 506/994] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:51.127448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.135008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.187543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 489/995] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:15:51.211316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.224575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.232585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742ab69-60cd-4aa3-beee-83cb90cd80ce None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.269477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.270130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.270416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.270689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.271507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:51.271929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.273995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.279861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 507/996] 10.222.0.65 () {56 vars in 1122 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:51.285413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.311645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6c9b4-b6b2-45bd-9095-ac1e0545a3e6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.347515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.348541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.348846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.349121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.349769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.351151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:51.363218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:51.364235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:51.365165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 490/997] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:51.370606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.392292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.397640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb54062-18ec-42f4-ab4f-129af81a1bb6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.438934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.439865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.440324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.440854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.441753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.446705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.474998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3afe5-744d-4f41-8999-e4c1bd365616 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.508261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.509025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.509303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.509575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.537047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:51.537047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.537047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.537047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 491/998] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:51.537047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.562360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 508/999] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:51.620460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.641333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5c195-55f4-429d-85ab-5db20a2c7047 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.685087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.685756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.686058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.686320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.687066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:51.687377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.688856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b360f9-1d77-4f58-80e1-64f2aa7c94ab None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.695507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 492/1000] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:51.701979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.724943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.772770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92841d5-ce46-45a6-af3a-4531e7779c3d None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.773108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92841d5-ce46-45a6-af3a-4531e7779c3d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.773388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92841d5-ce46-45a6-af3a-4531e7779c3d None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.774832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 493/1001] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:15:51.781619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.781904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.782182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.800419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:51.801636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:51.813128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827852-a5a6-407b-9858-906af61bbbec None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.849249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:51.850258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:51.850746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:51.851747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:51.852763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] RBAC: Adding query filter params (interface=public, service_id=7c66683b79144f1f90126fc88de6cd53, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:51.853282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:51.854859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:51.860506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 509/1002] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/endpoints?service_id=7c66683b79144f1f90126fc88de6cd53&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:51.865844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.884753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 494/1003] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:51.903242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:51.954390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:51.973390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98564673-694d-48a6-ba16-90c45a7fdb58 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:51.985056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:52.010104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:52.010772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:52.011057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:52.011333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:52.012012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:52.017873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:52.018422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2fb45-50f9-4453-8bac-d204acefa5e4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:52.020099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 510/1004] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:15:52.058345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:52.059175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:52.059456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:52.059733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] PATH_INFO: `/v3/services/image` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:52.060414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:52.061911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:52.075699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:52.076800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:52.077651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 495/1005] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Jun 16 20:15:51 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:52.084020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:52.196189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609a9bc-ddf8-43f4-a7d3-af71e5a4d917 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:52.232685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:52.233355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:52.233639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:52.233916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:52.234627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] RBAC: Adding query filter params (name=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:52.234934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:52.236295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b7f2d-41d2-496c-8cc8-f354c1946b30 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:52.241363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 511/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:52.246774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:52.347205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d034c1-0717-4601-9429-630d39cac634 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:52.380912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:52.381625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:52.381904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:52.382731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:52.383442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] RBAC: Adding query filter params (type=image) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:52.383745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:52.385134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45befb52-2203-4f47-8667-f7d372f9b451 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:52.386356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:52.396652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 496/1007] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:53.760016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ec485-aed2-41fe-aa52-12927648b8cd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:53.760531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ec485-aed2-41fe-aa52-12927648b8cd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:53.760669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ec485-aed2-41fe-aa52-12927648b8cd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:53.761958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 512/1008] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:53.767235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:53.767637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:53.767801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:53.784225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:53.785417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:53.852496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 497/1009] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:53.875890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ec485-aed2-41fe-aa52-12927648b8cd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:53.893106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:53.983410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ec485-aed2-41fe-aa52-12927648b8cd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:54.018058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c61c2-dc16-4585-854f-92f29e23da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:54.018857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c61c2-dc16-4585-854f-92f29e23da2c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.019142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c61c2-dc16-4585-854f-92f29e23da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.019419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c61c2-dc16-4585-854f-92f29e23da2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.020592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c61c2-dc16-4585-854f-92f29e23da2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:54.022036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c61c2-dc16-4585-854f-92f29e23da2c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:54.023853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 513/1010] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:54.029345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:54.128817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2de3a-f861-4447-9b33-2bf2e4178c5f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:54.154221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:54.162463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:54.171490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.171490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.171490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.171490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:54.171490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:54.267072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ff34-113f-417b-8bf0-53790a9f9d81 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.267570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ff34-113f-417b-8bf0-53790a9f9d81 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.267848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919ff34-113f-417b-8bf0-53790a9f9d81 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.269922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 514/1011] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:54.272350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 498/1012] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:54 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:15:54.275422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2314e7-568a-43c6-aedd-6d6e2ac8260c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.275714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2314e7-568a-43c6-aedd-6d6e2ac8260c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.275983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2314e7-568a-43c6-aedd-6d6e2ac8260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.294846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ed2314e7-568a-43c6-aedd-6d6e2ac8260c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:54.296068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ed2314e7-568a-43c6-aedd-6d6e2ac8260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:54.370803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 515/1013] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:54.393798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:54.508204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04981a-7f16-4e6e-9924-4d009e6912fc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:54.539758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045b60-b609-41ee-8060-5ca069b9afb0 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.540048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045b60-b609-41ee-8060-5ca069b9afb0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.540330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34045b60-b609-41ee-8060-5ca069b9afb0 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.541772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 516/1014] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:54.550221 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.550932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.551127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:54.551274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.552174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.552456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.552853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.553856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:54.555627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:54.574944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:54.575274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:54.576248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 20:15:54.577195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:54.578158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:54.578231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 499/1015] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:54.579035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:54.583884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:54.636299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:54.669889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 517/1016] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:54.692725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:54.693811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304ca39-25a0-4e7d-96aa-a643fde727e1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:54.735004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:54.736398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.736896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.737324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.738576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:54.739077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:54.741229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:54.751336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 500/1017] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:54.754186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:54.803063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80d2ac-1ac0-4a79-9609-be27e6b6fcfa None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:54.838723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ff6db-0cd9-4807-a5b7-a91947d27008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:54.839447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ff6db-0cd9-4807-a5b7-a91947d27008 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.839729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ff6db-0cd9-4807-a5b7-a91947d27008 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.840010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ff6db-0cd9-4807-a5b7-a91947d27008 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.840823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ff6db-0cd9-4807-a5b7-a91947d27008 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:54.842185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ff6db-0cd9-4807-a5b7-a91947d27008 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:54.864309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3bebb-27f2-4958-ac3b-42291d3d94bd None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:54.873525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:54.898603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:54.902890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:54.902890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:54.902890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:54.902890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:54.902890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:54.902890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:54.907121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 501/1018] 10.222.0.65 () {56 vars in 1112 bytes} [Thu Jun 16 20:15:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:54.912664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:54.967439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:54.984650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 518/1019] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:15:54 2022] POST /identity/v3/services => generated 242 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:55.017679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f35dc-5a73-4bb9-a158-dde7b425b7e2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:55.064225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45513ca0-cf55-43c2-a6fa-434ee4a2ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:55.064935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513ca0-cf55-43c2-a6fa-434ee4a2ddf0 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:55.065221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513ca0-cf55-43c2-a6fa-434ee4a2ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:55.065494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45513ca0-cf55-43c2-a6fa-434ee4a2ddf0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:55.066268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45513ca0-cf55-43c2-a6fa-434ee4a2ddf0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:55.067769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45513ca0-cf55-43c2-a6fa-434ee4a2ddf0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:55.156571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 502/1020] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:15:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:56.521398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef805ae-8d91-4b6b-876b-df8ee2df10a7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:56.522019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef805ae-8d91-4b6b-876b-df8ee2df10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:56.522019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef805ae-8d91-4b6b-876b-df8ee2df10a7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:56.523940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 519/1021] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:56.529050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:56.529432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:56.529609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:56.546699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:56.547888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:56.568198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:56.623280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 503/1022] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:56.649216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef805ae-8d91-4b6b-876b-df8ee2df10a7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:56.752979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef805ae-8d91-4b6b-876b-df8ee2df10a7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:56.786868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24f694-e175-4b13-bc32-9a9d3aff706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:56.787579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f694-e175-4b13-bc32-9a9d3aff706a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:56.787885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f694-e175-4b13-bc32-9a9d3aff706a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:56.788168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24f694-e175-4b13-bc32-9a9d3aff706a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:56.789366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24f694-e175-4b13-bc32-9a9d3aff706a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:56.790794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d24f694-e175-4b13-bc32-9a9d3aff706a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:56.797633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 520/1023] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:15:56.798587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:56.896785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1439312-505e-4234-bfd2-18b36765ec22 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:56.931723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8aac1-2593-4f73-b1c9-69b1f6e41262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:56.932396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8aac1-2593-4f73-b1c9-69b1f6e41262 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:56.932707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8aac1-2593-4f73-b1c9-69b1f6e41262 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:56.932987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8aac1-2593-4f73-b1c9-69b1f6e41262 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:56.933712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8aac1-2593-4f73-b1c9-69b1f6e41262 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:56.935136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8aac1-2593-4f73-b1c9-69b1f6e41262 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:57.028649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 504/1024] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:15:56 2022] POST /identity/v3/users => generated 285 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:15:57.376288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bf47-cd1e-40bd-bddf-6b334c2ff983 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.376708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bf47-cd1e-40bd-bddf-6b334c2ff983 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.376917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a894bf47-cd1e-40bd-bddf-6b334c2ff983 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.378485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 521/1025] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:57.383963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.384258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.384535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.396180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:57.402083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:57.403252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:57.423601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d929-10ac-4a8d-b5cc-dfaada757aae None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.423886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d929-10ac-4a8d-b5cc-dfaada757aae None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.424260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7d929-10ac-4a8d-b5cc-dfaada757aae None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.426239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 522/1026] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:57.431857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.432316 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.432825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.450718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:57.451890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:57.477984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 505/1027] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:57.501495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:57.520657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:57.529940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 523/1028] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:57.554426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:57.624488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe82f0b-99d2-409e-a004-9a91e98efef1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:57.666019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:57.666631 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad6db0-54ff-4bc0-b335-8f870fc53ed4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:57.667108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.667373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.667645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.671617 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:57.680677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:57.689270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:57.690218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:57.691085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 506/1029] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Jun 16 20:15:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:57.698034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:57.708090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:57.709344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.709651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.710465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] PATH_INFO: `/v3/services/image` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.711125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:57.712488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:57.724592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:57.725703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:57.726608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 524/1030] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Jun 16 20:15:57 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:57.732230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:57.795680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:57.811132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d96aa4-6bd4-4d5b-a2f5-dfefc3fa1c54 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:57.839004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995571de-2294-42f3-b248-73c61bc69566 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:57.845388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:57.846058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.846335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.846608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.847352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:57.847654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:57.849040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:57.861977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 507/1031] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:15:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:57.862874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:57.873823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:57.874500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:57.874788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:57.875065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:57.875779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] RBAC: Adding query filter params (name=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:57.876088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:57.877492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:57.883312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 525/1032] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:57.888442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:57.930161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:57.975023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5820c-8b62-40f0-8b50-f5f188371a78 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:57.987949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b78e92-c894-4653-86ca-b5ce2005ac1d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.010620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:58.011327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.012096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.012374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.012666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.021521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.022250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.022537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.022814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.023524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] RBAC: Adding query filter params (type=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:58.023831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.024297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.025234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.026076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.030143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 526/1033] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:58.035894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:58.044052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:58.045173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:58.046270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:58.046270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:58.046270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:58.046270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:58.048097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 508/1034] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:58.053980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.146818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa6a52-d1f0-41e7-af4f-c7370014cd07 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.152940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1fe8-36e5-45a8-9675-7cc0f8d87683 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.165474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:58.184064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.184893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.185006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.185202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.185989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] RBAC: Adding query filter params (interface=public, service_id=0953e5bc4c7841e0a0e10d5e2e48fb64, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:58.186303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.187660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.192741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.193306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 527/1035] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/endpoints?service_id=0953e5bc4c7841e0a0e10d5e2e48fb64&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:58.193499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.193753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.194114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.195407 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:58.195773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.197196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.199252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.215846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 509/1036] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:58.216956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.257116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:58.307987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86237201-1c66-4d90-ab70-4b0a81cbeed5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.326845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980c03d-1556-4696-a872-0c42c89dd090 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.344367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.345002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.345286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.345720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.346231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.347586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.355569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 528/1037] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:15:58.362922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.363733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.364013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.364284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.372896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.374380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:15:58.390904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:58.392047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:15:58.393097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:58.396965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 510/1038] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:58.398960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.511158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0500aa37-d88f-4636-ba77-db3a430cab03 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.528872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:58.547304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.547982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.548264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.548539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.549487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:58.549793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.553639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.572327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 529/1039] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:58.577348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.609473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:58.679412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d955ed-b248-40e7-b31b-067dba705291 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:58.712888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:58.713531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:58.713809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:58.714079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:58.781163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:58.782523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:58.811138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:58.881988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 511/1040] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:15:58.887594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:58.985761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99808958-f67c-4b67-b4e9-08f1f6c4e702 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.018952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.019736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.020014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.020284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.030908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.032409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d28dba16-6892-4c23-a7e9-cb44e642013a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:15:59.050544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:59.051479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:59.052383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:15:59.052383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:15:59.052383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:15:59.052383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:59.056366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 530/1041] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:15:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:15:59.057781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.159592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eb037-3419-4f32-8e4d-3b5a9c5cc2a8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.189606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:59.196816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.197487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.197767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.198043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.198763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:59.199070 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.200425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.208866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bf5f4-0ce6-4efa-b6f8-35f587110380 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.209164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bf5f4-0ce6-4efa-b6f8-35f587110380 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.209432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bf5f4-0ce6-4efa-b6f8-35f587110380 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.211656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 531/1042] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:15:59.214816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 512/1043] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:59.218305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.218651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.218864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.220243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.237422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:15:59.238636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:15:59.260483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:59.309628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 532/1044] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:15:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:15:59.327818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737012-f355-440f-b4ec-f772bfaa748d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.343799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.364628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.365977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.366263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.366544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.375893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.377525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:15:59.402994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:59.404104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:15:59.405044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 513/1045] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:59.410281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.454110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c525d-61d6-40d2-8c66-bea66c28a8a2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.462479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:59.491244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.492044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.492324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.493113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.503965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:15:59.512059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:15:59.513015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:15:59.513888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 533/1046] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:15:59.519111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.522560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2b30d-080a-4151-809d-a63acd8b0ded None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.539429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:59.564202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.565225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.565716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.566608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.567628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:59.568264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.571155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.587260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 514/1047] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:59.593340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.628201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4943-9b92-4187-8f28-33a70be6e8c6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.664636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.665330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.665614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.665890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.666898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:59.667207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.668559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.677090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 534/1048] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:59.682954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.695696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa946-f0e9-4d76-9361-424073d215f1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.707669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:59.732707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.733378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.733629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.733903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.734729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] RBAC: Adding query filter params (role.id=03b5dc906c2e4d389709e9bf5104ffae, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=7be4c89082ac47d786cf7e1821ed01b3) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:15:59.735037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.736444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.742524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 515/1049] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/role_assignments?user.id=7be4c89082ac47d786cf7e1821ed01b3&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=03b5dc906c2e4d389709e9bf5104ffae => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:59.775411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:15:59.799146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f7f53-3eb4-4180-a851-9e8d65cc26df None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:15:59.835061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087db91-a870-4798-a999-800512646f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:15:59.835860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087db91-a870-4798-a999-800512646f4e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:15:59.836144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087db91-a870-4798-a999-800512646f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:15:59.836424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087db91-a870-4798-a999-800512646f4e None admin] PATH_INFO: `/v3/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:15:59.850879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087db91-a870-4798-a999-800512646f4e None admin] RBAC: Authorizing `identity:get_user(user_id=5e11a3a0e3da4bfea035f7e2d1a4e6c6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:15:59.852329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087db91-a870-4798-a999-800512646f4e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:15:59.854338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 535/1050] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:15:59.860851 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:15:59.969023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a4a44-f1f4-470a-9178-74320a4ba231 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:00.002831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:00.003484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.003769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.004045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.047632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:00.072977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:00.074485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:00.174804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 516/1051] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:15:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:00.181209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087db91-a870-4798-a999-800512646f4e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:00.283443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087db91-a870-4798-a999-800512646f4e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:00.322589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63508-dea5-4e90-a7de-b223cf5be58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:00.323445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63508-dea5-4e90-a7de-b223cf5be58c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.323732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63508-dea5-4e90-a7de-b223cf5be58c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.324007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63508-dea5-4e90-a7de-b223cf5be58c None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.325207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63508-dea5-4e90-a7de-b223cf5be58c None admin] RBAC: Authorizing `identity:get_project(project_id=d4abadd7ef9241ab874651eaae032e2c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:00.326629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63508-dea5-4e90-a7de-b223cf5be58c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:00.328543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 536/1052] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:00 2022] GET /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:00.334877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:00.408600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:00.434217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e74bf6-1dd5-4344-bdd9-2cc284a753a2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:00.468729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:00.469745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.470234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.470716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.471771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=d4abadd7ef9241ab874651eaae032e2c, user.id=5e11a3a0e3da4bfea035f7e2d1a4e6c6) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:00.472327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:00.474045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d08da5-4cca-4861-a940-529a29bb9b53 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:00.481874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 517/1053] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:00 2022] GET /identity/v3/role_assignments?user.id=5e11a3a0e3da4bfea035f7e2d1a4e6c6&scope.project.id=d4abadd7ef9241ab874651eaae032e2c&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:00.554400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75a97-c9d8-42b7-a791-c9a331d063ab None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.554763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75a97-c9d8-42b7-a791-c9a331d063ab None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.554953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d75a97-c9d8-42b7-a791-c9a331d063ab None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.556703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 537/1054] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:00.562375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.562673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.562940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.580366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:00.581624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:00.657474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 518/1055] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:00.680228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75a97-c9d8-42b7-a791-c9a331d063ab None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:00.684357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:00.781470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d75a97-c9d8-42b7-a791-c9a331d063ab None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:00.815171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:00.815954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.816235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.816505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] PATH_INFO: `/v3/services/image` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.817192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:00.818565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:00.831616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:00.833095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 20:16:00.833948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:00.836696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 538/1056] 10.222.0.65 () {56 vars in 1105 bytes} [Thu Jun 16 20:16:00 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:00.839757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:00.907247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:00.941103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83093ec-7a60-4e82-85c4-6f7e4c7bf693 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:00.975937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:00.976597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:00.976917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:00.977198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:00.977903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] RBAC: Adding query filter params (name=image) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:00.978208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:00.979563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:00.988957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 519/1057] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:00.989983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:01.058355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:01.091220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5f748-3643-48e2-866f-0b2c5487b053 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:01.125167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:01.125832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:01.126115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:01.126389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:01.127092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:01.127401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:01.128786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4923d4-1cd2-49f5-b298-9f7b7b78bdf1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:01.134249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 539/1058] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:01.140112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:01.240376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e97eed-30c5-4035-b8ce-f4b62ca3857e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:01.270511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:01.275985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1dd79-f4ab-46a5-a6aa-da8174ce0404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:01.276666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1dd79-f4ab-46a5-a6aa-da8174ce0404 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:01.276954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1dd79-f4ab-46a5-a6aa-da8174ce0404 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:01.277226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1dd79-f4ab-46a5-a6aa-da8174ce0404 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:01.278071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1dd79-f4ab-46a5-a6aa-da8174ce0404 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:01.279483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1dd79-f4ab-46a5-a6aa-da8174ce0404 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:01.447332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 520/1059] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:16:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:16:01.874937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab30a1-e21c-4d86-bc5e-800cc4a9943d None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:01.875447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab30a1-e21c-4d86-bc5e-800cc4a9943d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:01.875447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab30a1-e21c-4d86-bc5e-800cc4a9943d None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:01.876827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 540/1060] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:01.882399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:01.882781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:01.882942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:01.899196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:01.900356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:01.975772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 521/1061] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:01.997681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab30a1-e21c-4d86-bc5e-800cc4a9943d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.096982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab30a1-e21c-4d86-bc5e-800cc4a9943d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.126743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:02.132659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.133467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.133745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.134013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.143954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:02.152226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:02.153171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:16:02.154101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:02.156951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 541/1062] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Jun 16 20:16:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:02.159616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.258901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff7389-f93b-4ef2-998d-08d52a5e0a39 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.273299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:02.293777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.294530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.294868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.295143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.296017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:02.296330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:02.297712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:02.307079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 522/1063] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:02.312873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.414108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4df0c-cd13-474a-954c-81be89bba2a3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.447552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.448480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.448793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.449072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.459557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:02.461018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-6b266019-40c5-461e-9d22-33a7d4b5d005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:16:02.478427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:02.479338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:02.485321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:16:02.485321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:16:02.485321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:02.485321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:02.485321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 542/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:02.485613 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.596397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d814e-bdb4-47af-8276-0454c3687379 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.627665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e42e-cec8-4e62-a4bb-4ac9b25b9ef3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.628014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e42e-cec8-4e62-a4bb-4ac9b25b9ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.628238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e42e-cec8-4e62-a4bb-4ac9b25b9ef3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.629780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 543/1065] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:16:02.630602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.631865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.632149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.632420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.633171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:02.633478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:02.634927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:02.635185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.635479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.635763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.647731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 523/1066] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:02.652918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.653826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:02.655014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:02.687906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:02.699197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:02.725872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 544/1067] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:16:02.749148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.758601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a609fae-4920-4016-85c3-9ee2fa52d2ed None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.793064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.793873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.794151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.794527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.802088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:02.804052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:16:02.819729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:02.820707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:02.821699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 524/1068] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:02.827465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.856731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d672bdb-2edb-4fc1-ae63-22d142a09659 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.892017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.892829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.893113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.893390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.903711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:02.911312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:02.912821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:02.913808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 545/1069] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:02.919293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:02.926356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:02.933664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd345-2e83-449c-b62f-9ce91e82d08b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:02.954380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:02.969995 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:02.970667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:02.970952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:02.971228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:02.972066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:02.972382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:02.973865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:02.996976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 525/1070] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:02.998913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.024303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec706fa-2f97-4289-a4fd-bb1c99dbe426 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.062740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.063408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.063687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.063960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.064728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:03.065032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.066384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.080478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 546/1071] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:03.081821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.103062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9405ed46-2803-4628-8d60-e74f2615e7b4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.138417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.139206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.139818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.139818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.150913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.152362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:16:03.170797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:03.171764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:03.173126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:16:03.173126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:16:03.173126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:03.173126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:03.173126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 526/1072] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:03.177549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.185950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:03.187040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:03.191746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ccd39-d486-4a8d-aac3-fb22ff7be45c None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.228433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.229256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.229533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.229801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] PATH_INFO: `/v3/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.231027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] RBAC: Authorizing `identity:get_user(user_id=5e11a3a0e3da4bfea035f7e2d1a4e6c6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.232444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.234593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 547/1073] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:03 2022] GET /identity/v3/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:03.241503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.284927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1cf6c-8f7f-4e54-aa95-2c6155a4c3e5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.320491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.321187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.321473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.321750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.322475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:03.322784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.324164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.338750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 527/1074] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:03.343872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.352590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599e7bc-f742-45cb-8b3c-ee93c849da5e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.390499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.391516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.391909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.392277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.393595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] RBAC: Authorizing `identity:get_project(project_id=d4abadd7ef9241ab874651eaae032e2c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.395109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.397150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 548/1075] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:03 2022] GET /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:03.402870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.425040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:03.436479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:03.465387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65861f-7655-41c9-8106-7383c49517bb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.504860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791402d6-8f31-4d16-adac-fde1e0611427 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.505841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.507256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.507778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.508146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.515126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.516649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:16:03.531965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:03.532989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:03.534602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 528/1076] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:16:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:03.539297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.545145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79177541-0c4e-493a-ba4f-45a2bfc2b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.546611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79177541-0c4e-493a-ba4f-45a2bfc2b53b None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.546611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79177541-0c4e-493a-ba4f-45a2bfc2b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.546611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79177541-0c4e-493a-ba4f-45a2bfc2b53b None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.548735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79177541-0c4e-493a-ba4f-45a2bfc2b53b None admin] RBAC: Authorizing `identity:create_grant(project_id=d4abadd7ef9241ab874651eaae032e2c, user_id=5e11a3a0e3da4bfea035f7e2d1a4e6c6, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.550198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79177541-0c4e-493a-ba4f-45a2bfc2b53b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.635718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 549/1077] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:16:03 2022] PUT /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:16:03.642914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd175c-6404-4372-86ef-52652b16fa79 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.650188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a468-d62b-4b13-ac70-27e522fd3306 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.650474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a468-d62b-4b13-ac70-27e522fd3306 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.650752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512a468-d62b-4b13-ac70-27e522fd3306 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.652139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 550/1078] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:03 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:03.662711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.662997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.663268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.674349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:03.685911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:03.686640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.687132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:03.687524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.687908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.688283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.689244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:03.689627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.691149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.704561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 529/1079] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:16:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:03.710660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.766277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 551/1080] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:03.789046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:03.817723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:03.829651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464c88b-62ee-4764-a622-465ff0eac3f2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.865865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.866804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.867083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.867354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/7be4c89082ac47d786cf7e1821ed01b3/roles/03b5dc906c2e4d389709e9bf5104ffae` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.869923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=7be4c89082ac47d786cf7e1821ed01b3, role_id=03b5dc906c2e4d389709e9bf5104ffae)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:03.871340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:03.893337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0075ff7-e245-4536-8097-afd8bb231295 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:03.926851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:03.927495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:03.927880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:03.928158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:03.968302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 530/1081] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:16:03 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/7be4c89082ac47d786cf7e1821ed01b3/roles/03b5dc906c2e4d389709e9bf5104ffae => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:16:04.001602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:04.003076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:04.030727 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:04.112905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 552/1082] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 20:16:04.119236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:04.172862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:04.226520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4dd25-e290-425b-b7eb-19cae255ec67 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:04.259832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:04.260642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:04.260928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:04.261209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:04.272329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:04.273799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-9e903252-21d9-4684-ab8b-0c366d4b8137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:16:04.291582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:04.292506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:04.294045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:16:04.294045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:16:04.294045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:04.294045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:04.294045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 531/1083] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:04.298815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:04.397497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2b0b2-ea42-4a3c-8918-b81b0208a9c5 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:04.420112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:04.432110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:04.432797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:04.433081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:04.433357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:04.434079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:04.434385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:04.437737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046c699-b72b-4bc1-9d67-c676292e70fa None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:04.455779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 553/1084] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:05.773249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccd03-0f43-4c43-93a1-fc131589272a None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:05.773774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccd03-0f43-4c43-93a1-fc131589272a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:05.773890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ccd03-0f43-4c43-93a1-fc131589272a None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:05.775161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 532/1085] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:05.780312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:05.780737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:05.780906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:05.797235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:05.798344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:05.863477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 554/1086] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:05.887448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ccd03-0f43-4c43-93a1-fc131589272a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:05.982410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:05.986759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ccd03-0f43-4c43-93a1-fc131589272a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.019388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5266f7-3334-4c1d-a147-cdd9bd7961d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.020162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5266f7-3334-4c1d-a147-cdd9bd7961d7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.020441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5266f7-3334-4c1d-a147-cdd9bd7961d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.020744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5266f7-3334-4c1d-a147-cdd9bd7961d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.031147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5266f7-3334-4c1d-a147-cdd9bd7961d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-ef5266f7-3334-4c1d-a147-cdd9bd7961d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:06.039505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:06.040771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:06.041897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 533/1087] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:06.047412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.103506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811704bb-39c5-4633-9fb0-b354194180dc None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.103788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811704bb-39c5-4633-9fb0-b354194180dc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.104061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811704bb-39c5-4633-9fb0-b354194180dc None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.105439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 534/1088] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:16:06.110185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.110468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.110743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.127788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:06.129001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:06.144888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a24f2f-dc03-4561-bd9d-72d855e5f9d2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.157556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.178712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.179378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.179660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.179958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.180736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:06.181052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.182415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.190682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 555/1089] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:06.196524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.200675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 535/1090] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:16:06.224113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.293586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159297-2052-49d2-af83-4282f00caff0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.309410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.320934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808f466-d898-418b-a9fe-f99803a50a5a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.325442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.326294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.326577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.326846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] PATH_INFO: `/v3/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.328031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] RBAC: Authorizing `identity:get_user(user_id=5e11a3a0e3da4bfea035f7e2d1a4e6c6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.329474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.331110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 556/1091] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/users/5e11a3a0e3da4bfea035f7e2d1a4e6c6 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:06.337195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.354390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.355197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.355480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.355754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.365552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:06.374109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:06.375231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:06.376161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 536/1092] 10.222.0.65 () {56 vars in 1120 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:06.379451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.381495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.435612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d0343-6bc8-4b89-b3a8-a7c259865b1d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.469440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.470074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.470357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.470633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.480551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f79330-b87d-49e5-87f0-bc4e54c74ad1 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.513357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.514019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.514302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.514585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.515334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:06.515642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.517040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.525410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 537/1093] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:06.530862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.537624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.539068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.544216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.584499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.627910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e0dd3-4412-414e-ab9c-22b03107377b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.638968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 557/1094] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 20:16:06.644783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.668484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.669307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.669593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.669865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.680390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.681865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:16:06.698868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:06.699911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:06.701258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:16:06.701258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:16:06.701258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:06.701258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:06.701258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 538/1095] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:06.705764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.741085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347042c-ecd5-4d27-b3ae-df6b78571a82 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.764890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.775060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.785358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.785358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.785358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.785358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d4abadd7ef9241ab874651eaae032e2c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.785358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.785358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 558/1096] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:06.786627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.798235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.802325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e6c74-6c0e-4344-bd05-a17497c0b20c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.836784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.837352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.837633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.837907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.838683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:06.838993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.840343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.851736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 539/1097] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:06.857268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:06.883311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f0700-2b25-463b-a725-0d7bfe9346f6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.916666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.917314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.917596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.917869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:06.918691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=d4abadd7ef9241ab874651eaae032e2c, user.id=5e11a3a0e3da4bfea035f7e2d1a4e6c6) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:06.919001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:06.920402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:06.926171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 559/1098] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/role_assignments?user.id=5e11a3a0e3da4bfea035f7e2d1a4e6c6&scope.project.id=d4abadd7ef9241ab874651eaae032e2c&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:06.956053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9fd9-1de9-42f3-87dc-2da7d71c84d8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:06.982244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:06.994323 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:06.995133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:06.995419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:06.995695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:07.003663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:07.005208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:16:07.021914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:07.023719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:07.024724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 540/1099] 10.222.0.65 () {56 vars in 1093 bytes} [Thu Jun 16 20:16:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 20:16:07.029755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:07.108298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:07.134375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bae83-2f99-4155-ae16-ca3df78510a6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:07.169962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:07.170635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:07.170918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:07.171227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:07.172115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:07.172463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:07.173973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:07.192851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 560/1100] 10.222.0.65 () {56 vars in 1133 bytes} [Thu Jun 16 20:16:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:07.199019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:07.295495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f236-79ec-49a3-a3b7-aa64454dedd3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:07.329838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:07.330491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:07.330776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:07.331054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:07.378430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:07.396833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:07.398320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:07.504532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 541/1101] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:07.510583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:07.609105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62763737-bec1-4c3e-abaf-30d76daed99f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:07.639170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:07.644516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:07.645358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:07.645642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:07.645919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:07.655710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:07.657250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:16:07.679274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:07.680471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:07.682273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:16:07.682273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:16:07.682273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:16:07.682273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:07.682273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 561/1102] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:07.687019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:07.766840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:07.784919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52439a48-f134-4fed-94cc-9014cfd2ba34 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:07.819140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:07.819802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:07.820083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:07.820360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:07.821148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:07.821458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:07.822858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:07.834572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 542/1103] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:07.840220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:07.940736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde2cb-726e-4475-9cd0-d997172f0b6f None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:07.975670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:07.976478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:07.976791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:07.977069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:07.983988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:07.985460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:16:07.999296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:08.000355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:08.001342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 562/1104] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:16:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:08.006505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:08.114462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5be33e-faa1-42e5-ad5b-92346196e1eb None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:08.147130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:08.147796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:08.148085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:08.148365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:08.149195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:08.149510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:08.151519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f21306-48ed-4a24-90cb-2f7e7290453d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:08.163290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 543/1105] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:16:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:08.169691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:08.215604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:08.268889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e94e66-61c6-4bf7-a290-ed54f0fb9681 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:08.300871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:08.301523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:08.301811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:08.302091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:08.302932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] RBAC: Adding query filter params (role.id=03b5dc906c2e4d389709e9bf5104ffae, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=7be4c89082ac47d786cf7e1821ed01b3) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:08.303251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:08.304702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82c333-8e4e-4a11-80a6-090e19d03aa3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:08.311032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 563/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:08 2022] GET /identity/v3/role_assignments?user.id=7be4c89082ac47d786cf7e1821ed01b3&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=03b5dc906c2e4d389709e9bf5104ffae => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:09.119060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e1f8-a8bf-4c94-9cf4-8f7e6a450813 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:09.119602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e1f8-a8bf-4c94-9cf4-8f7e6a450813 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:09.119602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e1f8-a8bf-4c94-9cf4-8f7e6a450813 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:09.121028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 544/1107] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:16:09.126361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:09.126773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:09.126936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:09.143709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:09.144945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:09.210671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 564/1108] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:09.236148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e1f8-a8bf-4c94-9cf4-8f7e6a450813 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:09.239071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:09.335391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e1f8-a8bf-4c94-9cf4-8f7e6a450813 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:09.367376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85242d04-b985-4e55-bfdc-7fe0e8cfc33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:09.368168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242d04-b985-4e55-bfdc-7fe0e8cfc33a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:09.368451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242d04-b985-4e55-bfdc-7fe0e8cfc33a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:09.368752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242d04-b985-4e55-bfdc-7fe0e8cfc33a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:09.369997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85242d04-b985-4e55-bfdc-7fe0e8cfc33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:09.371399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85242d04-b985-4e55-bfdc-7fe0e8cfc33a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:09.373552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 545/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:09.379217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:09.424377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:09.481553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecdfd0-5bb3-474a-8a30-64c2a3c4e44b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:09.524936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff9432-c2f9-46a8-b7ea-8eaf6aa2ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:09.525606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9432-c2f9-46a8-b7ea-8eaf6aa2ffc7 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:09.525896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9432-c2f9-46a8-b7ea-8eaf6aa2ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:09.526179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff9432-c2f9-46a8-b7ea-8eaf6aa2ffc7 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:09.526904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff9432-c2f9-46a8-b7ea-8eaf6aa2ffc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:09.528347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff9432-c2f9-46a8-b7ea-8eaf6aa2ffc7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:09.627307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 565/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:16:09 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:16:11.793533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937252d-0a28-49e8-86b0-87c937039603 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:11.794089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937252d-0a28-49e8-86b0-87c937039603 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:11.794089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937252d-0a28-49e8-86b0-87c937039603 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:11.795391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 546/1111] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:11.800506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:11.800978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:11.801103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:11.818169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:11.819353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:11.883311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 566/1112] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:16:11.906278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937252d-0a28-49e8-86b0-87c937039603 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:11.975180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:12.006791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937252d-0a28-49e8-86b0-87c937039603 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:12.039488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:12.040330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:12.040610 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:12.040922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] PATH_INFO: `/v3/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:12.042387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] RBAC: Authorizing `identity:get_role(role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:12.043798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:12.045803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 547/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:11 2022] GET /identity/v3/roles/ef55a3c470c94814b91be114d41243c5 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:12.051516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:12.075442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:12.147992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38c2c4-9b40-4b88-b67c-df4a60e0213e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:12.180905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:12.181764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:12.182046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:12.182319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] PATH_INFO: `/v3/users/e59d3bc7251b41d7b2506dd87990fcaa` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:12.195219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e59d3bc7251b41d7b2506dd87990fcaa)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:12.196672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:12.198304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 567/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:12 2022] GET /identity/v3/users/e59d3bc7251b41d7b2506dd87990fcaa => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:12.204545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:12.299860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514a359-9580-4489-abed-13b7c131dfdc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:12.332157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:12.332808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:12.333118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:12.333399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:12.341467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:12.398155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:12.399590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:12.495294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 548/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:12.501351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:12.581633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:12.598947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0276c52-ddd0-40bc-b2bd-4556751688c2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:12.632759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9674-4f26-4fe9-b7b8-5ed739f554fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:12.633616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9674-4f26-4fe9-b7b8-5ed739f554fb None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:12.633894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9674-4f26-4fe9-b7b8-5ed739f554fb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:12.634166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9674-4f26-4fe9-b7b8-5ed739f554fb None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:12.635334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9674-4f26-4fe9-b7b8-5ed739f554fb None admin] RBAC: Authorizing `identity:get_project(project_id=d4abadd7ef9241ab874651eaae032e2c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:12.636825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec9674-4f26-4fe9-b7b8-5ed739f554fb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:12.638592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 568/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:12 2022] GET /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:12.644603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:12.682208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:12.738985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c68ac-255a-4f02-bb83-2a47ee6e7dac None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:12.772276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:12.772947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:12.773230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:12.773515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:12.774346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] RBAC: Adding query filter params (role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=d4abadd7ef9241ab874651eaae032e2c, user.id=e59d3bc7251b41d7b2506dd87990fcaa) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:12.774657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:12.776081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43a0cf-dd9f-4c46-b469-99b8ebe8ef7e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:12.781392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 549/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:12 2022] GET /identity/v3/role_assignments?user.id=e59d3bc7251b41d7b2506dd87990fcaa&scope.project.id=d4abadd7ef9241ab874651eaae032e2c&role.id=ef55a3c470c94814b91be114d41243c5 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:14.855969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b913a-ca54-44ec-9f9d-70a07f37c628 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:14.856485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b913a-ca54-44ec-9f9d-70a07f37c628 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:14.856485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b913a-ca54-44ec-9f9d-70a07f37c628 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:14.857845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 569/1118] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:14.862912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:14.863341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:14.863469 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:14.880907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:14.882101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:14.945837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 550/1119] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:14.968904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b913a-ca54-44ec-9f9d-70a07f37c628 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:15.065471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b913a-ca54-44ec-9f9d-70a07f37c628 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:15.097510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:15.098346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:15.098630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:15.098911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] PATH_INFO: `/v3/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:15.100400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] RBAC: Authorizing `identity:get_role(role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:15.101792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:15.103137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 570/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:14 2022] GET /identity/v3/roles/ef55a3c470c94814b91be114d41243c5 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:15.109000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:15.139235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:15.203989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cf1b3-6b25-4de4-b192-c5f05c9f678c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:15.235560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:15.236412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:15.236722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:15.236997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] PATH_INFO: `/v3/users/e59d3bc7251b41d7b2506dd87990fcaa` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:15.238250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] RBAC: Authorizing `identity:get_user(user_id=e59d3bc7251b41d7b2506dd87990fcaa)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:15.239681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:15.241321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 551/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:15 2022] GET /identity/v3/users/e59d3bc7251b41d7b2506dd87990fcaa => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:15.247416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:15.266486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:15.343609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a5bfb-06ca-4f05-89eb-3edc9f341435 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:15.376377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84356b0-8917-413d-9334-c5f95c338461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:15.377183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84356b0-8917-413d-9334-c5f95c338461 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:15.377470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84356b0-8917-413d-9334-c5f95c338461 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:15.377744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84356b0-8917-413d-9334-c5f95c338461 None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:15.378908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84356b0-8917-413d-9334-c5f95c338461 None admin] RBAC: Authorizing `identity:get_project(project_id=d4abadd7ef9241ab874651eaae032e2c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:15.380320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84356b0-8917-413d-9334-c5f95c338461 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:15.382014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 571/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:15 2022] GET /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:15.388520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:15.480715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:15.483550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2016015d-0e35-45bc-9bca-4904c10e06ea None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:15.516150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece67c39-0f14-482f-950c-4504eb32bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:15.517276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece67c39-0f14-482f-950c-4504eb32bcaa None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:15.517837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece67c39-0f14-482f-950c-4504eb32bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:15.518116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece67c39-0f14-482f-950c-4504eb32bcaa None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c/users/e59d3bc7251b41d7b2506dd87990fcaa/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:15.520302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece67c39-0f14-482f-950c-4504eb32bcaa None admin] RBAC: Authorizing `identity:create_grant(project_id=d4abadd7ef9241ab874651eaae032e2c, user_id=e59d3bc7251b41d7b2506dd87990fcaa, role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:15.521754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece67c39-0f14-482f-950c-4504eb32bcaa None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:15.587392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 552/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:16:15 2022] PUT /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c/users/e59d3bc7251b41d7b2506dd87990fcaa/roles/ef55a3c470c94814b91be114d41243c5 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:16:17.680369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d0f4-162e-4baa-946e-a4524e781ef7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:17.680926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d0f4-162e-4baa-946e-a4524e781ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:17.681016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d0f4-162e-4baa-946e-a4524e781ef7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:17.682347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 572/1124] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:17.687801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:17.688327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:17.688327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:17.705440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:17.706606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:17.769622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 553/1125] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:17.792674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d0f4-162e-4baa-946e-a4524e781ef7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:17.874917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:17.890298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d0f4-162e-4baa-946e-a4524e781ef7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:17.926979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:17.927892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:17.928179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:17.928457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] PATH_INFO: `/v3/roles/ef55a3c470c94814b91be114d41243c5` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:17.930548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] RBAC: Authorizing `identity:get_role(role_id=ef55a3c470c94814b91be114d41243c5)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:17.931923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:17.933381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 573/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:17 2022] GET /identity/v3/roles/ef55a3c470c94814b91be114d41243c5 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:17.939203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:18.024696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:18.033878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c649f-4a3b-4174-aa8a-8492a9a04eda None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:18.067097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:18.067949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:18.068306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:18.068584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] PATH_INFO: `/v3/users/e59d3bc7251b41d7b2506dd87990fcaa` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:18.069786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] RBAC: Authorizing `identity:get_user(user_id=e59d3bc7251b41d7b2506dd87990fcaa)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:18.071251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:18.072942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 554/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:17 2022] GET /identity/v3/users/e59d3bc7251b41d7b2506dd87990fcaa => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:18.078938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:18.174597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b2d13-6b9f-41c6-9900-17b63e3a6641 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:18.206858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:18.207479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:18.207760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:18.208033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:18.231183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:18.273437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:18.274873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:18.367362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 574/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:18.373354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:18.469399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ef6d-da32-4e7a-a2d4-31b9577ea119 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:18.501347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471fea9-5f95-4d89-847a-5f367d94705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:18.502178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471fea9-5f95-4d89-847a-5f367d94705b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:18.502452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471fea9-5f95-4d89-847a-5f367d94705b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:18.502717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471fea9-5f95-4d89-847a-5f367d94705b None admin] PATH_INFO: `/v3/projects/d4abadd7ef9241ab874651eaae032e2c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:18.503883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471fea9-5f95-4d89-847a-5f367d94705b None admin] RBAC: Authorizing `identity:get_project(project_id=d4abadd7ef9241ab874651eaae032e2c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:18.505475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471fea9-5f95-4d89-847a-5f367d94705b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:18.507130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 555/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:18 2022] GET /identity/v3/projects/d4abadd7ef9241ab874651eaae032e2c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:18.513711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:18.570863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:18.612322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23000f-d6e2-4f3c-ae10-c77977fece8a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:18.644975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:18.645615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:18.645896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:18.646170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:18.646988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] RBAC: Adding query filter params (role.id=ef55a3c470c94814b91be114d41243c5, scope.project.id=d4abadd7ef9241ab874651eaae032e2c, user.id=e59d3bc7251b41d7b2506dd87990fcaa) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:18.647295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:18.648724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961ee0e-0c8d-47b7-9eb5-da86e807e4bf None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:18.654371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 575/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:18 2022] GET /identity/v3/role_assignments?user.id=e59d3bc7251b41d7b2506dd87990fcaa&scope.project.id=d4abadd7ef9241ab874651eaae032e2c&role.id=ef55a3c470c94814b91be114d41243c5 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:20.783890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bc2d4-e234-490b-9285-72c4b726c01c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:20.784961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bc2d4-e234-490b-9285-72c4b726c01c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:20.785053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bc2d4-e234-490b-9285-72c4b726c01c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:20.786386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 556/1131] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:20.791763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:20.792151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:20.792360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:20.809235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:20.810352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:20.873585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 576/1132] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:20.896969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bc2d4-e234-490b-9285-72c4b726c01c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:20.924432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:21.002638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bc2d4-e234-490b-9285-72c4b726c01c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:21.035802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a52651-d8ed-4eec-a6c7-6ad978f32a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:21.036577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52651-d8ed-4eec-a6c7-6ad978f32a7b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:21.036893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52651-d8ed-4eec-a6c7-6ad978f32a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:21.037175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a52651-d8ed-4eec-a6c7-6ad978f32a7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:21.038351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52651-d8ed-4eec-a6c7-6ad978f32a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:21.040048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a52651-d8ed-4eec-a6c7-6ad978f32a7b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:21.041705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 557/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:21.047561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:21.093940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:21.141663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f42d3d-243f-4364-bed3-2865dc46e4c4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:21.176174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1112b1e-a7ac-44ea-86e9-2dfa49b504bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:21.176848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112b1e-a7ac-44ea-86e9-2dfa49b504bb None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:21.177138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112b1e-a7ac-44ea-86e9-2dfa49b504bb None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:21.177416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1112b1e-a7ac-44ea-86e9-2dfa49b504bb None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:21.178135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1112b1e-a7ac-44ea-86e9-2dfa49b504bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:21.179556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1112b1e-a7ac-44ea-86e9-2dfa49b504bb None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:21.269715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 577/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:16:21 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:16:23.392433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffa5f4-0d3c-4dd9-9a39-b683bfdf90ae None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:23.393001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffa5f4-0d3c-4dd9-9a39-b683bfdf90ae None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:23.393001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffa5f4-0d3c-4dd9-9a39-b683bfdf90ae None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:23.394376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 558/1135] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:23.399455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:23.399831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:23.400013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:23.416248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:23.417564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:23.481508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 578/1136] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:23.506518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffa5f4-0d3c-4dd9-9a39-b683bfdf90ae None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:23.599206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:23.606844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffa5f4-0d3c-4dd9-9a39-b683bfdf90ae None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:23.640933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a50bd-6854-4e8c-8310-9f24332d5d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:23.641713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a50bd-6854-4e8c-8310-9f24332d5d73 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:23.641993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a50bd-6854-4e8c-8310-9f24332d5d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:23.642267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a50bd-6854-4e8c-8310-9f24332d5d73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:23.643485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a50bd-6854-4e8c-8310-9f24332d5d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:23.644920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a50bd-6854-4e8c-8310-9f24332d5d73 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:23.646510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 559/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:16:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:23.652343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:23.681602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:23.749604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9ea5b-c5fa-455f-8482-b367d040f8ae None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:23.781827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61f3c1-6820-43a7-a6ec-0c6519181c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:23.782480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61f3c1-6820-43a7-a6ec-0c6519181c44 None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:23.782761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61f3c1-6820-43a7-a6ec-0c6519181c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:23.783032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61f3c1-6820-43a7-a6ec-0c6519181c44 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:23.783804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61f3c1-6820-43a7-a6ec-0c6519181c44 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:23.785258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc61f3c1-6820-43a7-a6ec-0c6519181c44 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:23.907723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 579/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:16:23 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:16:26.051451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd72fa4-a130-4060-b85d-ff6ff1bf92c3 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:26.051984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd72fa4-a130-4060-b85d-ff6ff1bf92c3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:26.051984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd72fa4-a130-4060-b85d-ff6ff1bf92c3 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:26.053657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 560/1139] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:26.058724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:26.059113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:26.059277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:26.076133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:26.077368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:26.142502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 580/1140] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:26.165369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd72fa4-a130-4060-b85d-ff6ff1bf92c3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:26.262032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd72fa4-a130-4060-b85d-ff6ff1bf92c3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:26.294039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:26.294806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:26.295087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:26.295362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:26.305373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:26.312826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:26.314476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:26.315639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 561/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:26.320194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:26.337492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:26.416095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68595c97-d82a-4d50-8b54-75731cb5ac55 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:26.450447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:26.451298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:26.451583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:26.451863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:26.452598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:26.452936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:26.454276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:26.462718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 581/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:26.468981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:26.493990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:26.570190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac1dcd-5747-41d3-a3fc-42cd702ae072 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:26.602778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:26.608586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:26.608586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:26.608586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] PATH_INFO: `/v3/users/12976b75b5f54563afecba49fa037166` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:26.617252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] RBAC: Authorizing `identity:get_user(user_id=12976b75b5f54563afecba49fa037166)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:26.618692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:26.620318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 562/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:26 2022] GET /identity/v3/users/12976b75b5f54563afecba49fa037166 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:26.626392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:26.703557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:26.724564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e33fc-6db3-497c-9c86-464761d92460 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:26.755776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:26.756404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:26.756706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:26.756979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:26.819947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:26.821441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:26.892295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:26.914225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 582/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:26.920150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:26.997391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:27.014797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005aa9d-42b1-4a21-acd8-663336388a3e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:27.047923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671c285-ad3e-4077-a54b-611909e68d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:27.048791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671c285-ad3e-4077-a54b-611909e68d57 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:27.049077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671c285-ad3e-4077-a54b-611909e68d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:27.049353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671c285-ad3e-4077-a54b-611909e68d57 None admin] PATH_INFO: `/v3/projects/23b699c411534190b7ea7fbed2d6f9da` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:27.050567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671c285-ad3e-4077-a54b-611909e68d57 None admin] RBAC: Authorizing `identity:get_project(project_id=23b699c411534190b7ea7fbed2d6f9da)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:27.052027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671c285-ad3e-4077-a54b-611909e68d57 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:27.053723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 563/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:26 2022] GET /identity/v3/projects/23b699c411534190b7ea7fbed2d6f9da => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:27.059931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:27.154369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002face5-84fa-4835-a9a4-6b8b9541f2d8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:27.187287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:27.187911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:27.188190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:27.188459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:27.189301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=23b699c411534190b7ea7fbed2d6f9da, user.id=12976b75b5f54563afecba49fa037166) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:27.189608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:27.191503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe64c66-f20d-46d4-884a-55b0920802dc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:27.196744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 583/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:27 2022] GET /identity/v3/role_assignments?user.id=12976b75b5f54563afecba49fa037166&scope.project.id=23b699c411534190b7ea7fbed2d6f9da&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:29.320944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582b9dd-2714-4ee4-aca7-201c8e47fa54 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:29.321483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582b9dd-2714-4ee4-aca7-201c8e47fa54 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:29.321483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582b9dd-2714-4ee4-aca7-201c8e47fa54 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:29.322871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 564/1147] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:29.328208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:29.328674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:29.328779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:29.345636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:29.346880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:29.381133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:29.413190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 584/1148] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:29.436225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582b9dd-2714-4ee4-aca7-201c8e47fa54 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:29.534745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582b9dd-2714-4ee4-aca7-201c8e47fa54 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:29.567673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:29.568448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:29.568766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:29.569047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:29.579528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:29.587567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:29.588754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:29.589810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 565/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:29.594957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:29.687892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81323c4-77c4-4ce4-8132-45b72d4bed5b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:29.719712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:29.720353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:29.720652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:29.720929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:29.721750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:29.722052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:29.723553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:29.731232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 585/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:29.736857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:29.748299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:29.833333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119ec4d-0aa5-49b3-aacc-6fbde93fd38f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:29.865020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:29.865879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:29.866165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:29.866443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] PATH_INFO: `/v3/users/12976b75b5f54563afecba49fa037166` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:29.868170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] RBAC: Authorizing `identity:get_user(user_id=12976b75b5f54563afecba49fa037166)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:29.869630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:29.871250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 566/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:29 2022] GET /identity/v3/users/12976b75b5f54563afecba49fa037166 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:29.877183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:29.911539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:29.973395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9d948-8add-4d59-9aa5-d6e811d46867 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:30.005070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41453732-be31-43ca-a41b-4ed8c55bba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:30.005912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453732-be31-43ca-a41b-4ed8c55bba20 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:30.006192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453732-be31-43ca-a41b-4ed8c55bba20 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:30.006465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41453732-be31-43ca-a41b-4ed8c55bba20 None admin] PATH_INFO: `/v3/projects/23b699c411534190b7ea7fbed2d6f9da` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:30.008142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41453732-be31-43ca-a41b-4ed8c55bba20 None admin] RBAC: Authorizing `identity:get_project(project_id=23b699c411534190b7ea7fbed2d6f9da)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:30.009566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41453732-be31-43ca-a41b-4ed8c55bba20 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:30.011226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 586/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:29 2022] GET /identity/v3/projects/23b699c411534190b7ea7fbed2d6f9da => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:30.016974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:30.091111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:30.112922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da673f-3764-4303-b5db-1282e0d8755a None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:30.145185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b426e0-261f-4263-b695-6a11d3aa3017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:30.146048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b426e0-261f-4263-b695-6a11d3aa3017 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:30.146324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b426e0-261f-4263-b695-6a11d3aa3017 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:30.146597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b426e0-261f-4263-b695-6a11d3aa3017 None admin] PATH_INFO: `/v3/projects/23b699c411534190b7ea7fbed2d6f9da/users/12976b75b5f54563afecba49fa037166/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:30.148532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b426e0-261f-4263-b695-6a11d3aa3017 None admin] RBAC: Authorizing `identity:create_grant(project_id=23b699c411534190b7ea7fbed2d6f9da, user_id=12976b75b5f54563afecba49fa037166, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:30.149971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b426e0-261f-4263-b695-6a11d3aa3017 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:30.264467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 567/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:16:30 2022] PUT /identity/v3/projects/23b699c411534190b7ea7fbed2d6f9da/users/12976b75b5f54563afecba49fa037166/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:16:32.349817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8696d-4b36-4c18-8f95-9a10e7458338 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:32.350349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8696d-4b36-4c18-8f95-9a10e7458338 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:32.350349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8696d-4b36-4c18-8f95-9a10e7458338 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:32.351744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 587/1154] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:32.357340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:32.357766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:32.357891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:32.374643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:32.375823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:32.438841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 568/1155] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:32.461834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8696d-4b36-4c18-8f95-9a10e7458338 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:32.560045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8696d-4b36-4c18-8f95-9a10e7458338 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:32.561575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:32.593246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:32.594229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:32.594774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:32.595054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:32.605452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:32.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:32.614203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:32.615352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 588/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:32.620855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:32.681535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:32.715587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c6b34-2ac0-45b0-844a-5348c2c09e9e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:32.747834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:32.748489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:32.748803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:32.749080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:32.749831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:32.750139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:32.751501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:32.759676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 569/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:16:32.765743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:32.863111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0ce61-7030-4304-bb5b-93aa8a9867fa None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:32.894691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:32.895702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:32.895984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:32.896256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] PATH_INFO: `/v3/users/12976b75b5f54563afecba49fa037166` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:32.897517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] RBAC: Authorizing `identity:get_user(user_id=12976b75b5f54563afecba49fa037166)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:32.898957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:32.900630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 589/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:32 2022] GET /identity/v3/users/12976b75b5f54563afecba49fa037166 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:32.906823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:33.002543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60722d9-fcf3-4b3d-802f-d1ec13bd7972 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:33.027132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:33.034475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:33.035102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:33.035384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:33.035659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:33.100656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:33.102104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:33.200673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 570/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:33.206469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:33.236857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:33.302453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff7250-70e6-458c-81cf-fff24b74f42e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:33.334854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b00cf6-2fa5-4f31-96ef-db7a4ef37ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:33.335699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b00cf6-2fa5-4f31-96ef-db7a4ef37ead None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:33.335983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b00cf6-2fa5-4f31-96ef-db7a4ef37ead None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:33.336259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b00cf6-2fa5-4f31-96ef-db7a4ef37ead None admin] PATH_INFO: `/v3/projects/23b699c411534190b7ea7fbed2d6f9da` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:33.337456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b00cf6-2fa5-4f31-96ef-db7a4ef37ead None admin] RBAC: Authorizing `identity:get_project(project_id=23b699c411534190b7ea7fbed2d6f9da)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:33.338869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b00cf6-2fa5-4f31-96ef-db7a4ef37ead None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:33.341132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 590/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:33 2022] GET /identity/v3/projects/23b699c411534190b7ea7fbed2d6f9da => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:33.347155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:33.374556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:33.443210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976e829-b82c-4956-9402-af0288fc25fc None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:33.476757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:33.477322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:33.477601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:33.477871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:33.478694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=23b699c411534190b7ea7fbed2d6f9da, user.id=12976b75b5f54563afecba49fa037166) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:33.479001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:33.480991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae31b0-8ca6-4e33-a0c4-e678525f1df2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:33.486652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 571/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:33 2022] GET /identity/v3/role_assignments?user.id=12976b75b5f54563afecba49fa037166&scope.project.id=23b699c411534190b7ea7fbed2d6f9da&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:35.615921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419db0f-279b-4827-8a5d-c539cb45b035 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:35.616435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419db0f-279b-4827-8a5d-c539cb45b035 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:35.616527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419db0f-279b-4827-8a5d-c539cb45b035 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:35.617870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 591/1162] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:35.622941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:35.623356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:35.623488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:35.640082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:35.641332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:35.705097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 572/1163] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:16:35.727523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419db0f-279b-4827-8a5d-c539cb45b035 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:35.819625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:35.824064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419db0f-279b-4827-8a5d-c539cb45b035 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:35.855860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:35.856488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:35.856801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:35.857078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:35.921216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:35.922633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:36.011760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:36.016401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 592/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:36.022347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:36.044999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:36.117695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5d96a-3631-41bc-b7c3-f0336ef66570 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:36.150290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:36.151073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:36.151351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:36.151649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:36.158645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:36.160063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-a90cd6ff-50e5-48b8-afb4-90b117dec223 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:36.174020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:36.175215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:36.176085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 573/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:16:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:36.181399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:36.275477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529e60a9-cf62-4a31-b891-a7e5355999bc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:36.308075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:36.308758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:36.309045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:36.309321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:36.310064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:36.310372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:36.311732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a92ee8-8e91-4e75-888a-93eac5781913 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:36.318924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 593/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Thu Jun 16 20:16:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:38.398517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7cab-0215-422e-99bb-d522be61f7a6 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:38.399074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7cab-0215-422e-99bb-d522be61f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:38.399074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf7cab-0215-422e-99bb-d522be61f7a6 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:38.400420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 574/1167] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:38.405461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f95c8-63fc-449b-876b-414aaee7e943 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:38.405860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f95c8-63fc-449b-876b-414aaee7e943 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:38.406021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f95c8-63fc-449b-876b-414aaee7e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:38.422571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-be0f95c8-63fc-449b-876b-414aaee7e943 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:38.423737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-be0f95c8-63fc-449b-876b-414aaee7e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:38.476769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:38.486846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 594/1168] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:38.509989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7cab-0215-422e-99bb-d522be61f7a6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:38.590486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:38.608479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf7cab-0215-422e-99bb-d522be61f7a6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:38.642295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb5585-cecf-4550-b952-8e8a8cd06d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:38.642943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb5585-cecf-4550-b952-8e8a8cd06d74 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:38.643224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb5585-cecf-4550-b952-8e8a8cd06d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:38.643500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb5585-cecf-4550-b952-8e8a8cd06d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:38.644244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb5585-cecf-4550-b952-8e8a8cd06d74 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:38.645634 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb5585-cecf-4550-b952-8e8a8cd06d74 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:38.712208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 575/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Thu Jun 16 20:16:38 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:16:40.844119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44945668-3ecf-46b8-aee4-e74b2a9c9289 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:40.844756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44945668-3ecf-46b8-aee4-e74b2a9c9289 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:40.844756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44945668-3ecf-46b8-aee4-e74b2a9c9289 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:40.846047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 595/1170] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:40.851338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55698179-0449-4396-893a-355fb441e8bc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:40.851733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55698179-0449-4396-893a-355fb441e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:40.851902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55698179-0449-4396-893a-355fb441e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:40.870054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-55698179-0449-4396-893a-355fb441e8bc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:40.871387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-55698179-0449-4396-893a-355fb441e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:40.935597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 576/1171] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:40.959778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44945668-3ecf-46b8-aee4-e74b2a9c9289 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:41.058725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44945668-3ecf-46b8-aee4-e74b2a9c9289 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:41.090635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d2c5f-7c7d-4dd3-842c-4182373069a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:41.091476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2c5f-7c7d-4dd3-842c-4182373069a2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:41.091759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2c5f-7c7d-4dd3-842c-4182373069a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:41.092030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d2c5f-7c7d-4dd3-842c-4182373069a2 None admin] PATH_INFO: `/v3/domains/0632740a83c6469f8e0ab9c5b7e16d81` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:41.102530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d2c5f-7c7d-4dd3-842c-4182373069a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0632740a83c6469f8e0ab9c5b7e16d81)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:41.103927 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d2c5f-7c7d-4dd3-842c-4182373069a2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:41.105562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 596/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Thu Jun 16 20:16:40 2022] GET /identity/v3/domains/0632740a83c6469f8e0ab9c5b7e16d81 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:41.111259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55698179-0449-4396-893a-355fb441e8bc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:41.178352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:41.206725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55698179-0449-4396-893a-355fb441e8bc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:41.240104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06577ba-55c1-4f73-a8ea-1f8c4211c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:41.240784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06577ba-55c1-4f73-a8ea-1f8c4211c7dd None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:41.241066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06577ba-55c1-4f73-a8ea-1f8c4211c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:41.241343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06577ba-55c1-4f73-a8ea-1f8c4211c7dd None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:41.242117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06577ba-55c1-4f73-a8ea-1f8c4211c7dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:41.243540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06577ba-55c1-4f73-a8ea-1f8c4211c7dd None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:41.333862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 577/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:16:41 2022] POST /identity/v3/projects => generated 361 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:16:43.458097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ced7-b4db-4e9a-a7d8-a8ebaba80439 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:43.458677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ced7-b4db-4e9a-a7d8-a8ebaba80439 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:43.458677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693ced7-b4db-4e9a-a7d8-a8ebaba80439 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:43.460021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 597/1174] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:43.465073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:43.465466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:43.465632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:43.481996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:43.483166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:43.546971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 578/1175] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:43.572490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693ced7-b4db-4e9a-a7d8-a8ebaba80439 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:43.625046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:43.670422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693ced7-b4db-4e9a-a7d8-a8ebaba80439 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:43.702685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d512b4-4ad6-4ccc-8ddb-ea3f5b3cf2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:43.703523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d512b4-4ad6-4ccc-8ddb-ea3f5b3cf2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:43.703802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d512b4-4ad6-4ccc-8ddb-ea3f5b3cf2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:43.704073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d512b4-4ad6-4ccc-8ddb-ea3f5b3cf2f4 None admin] PATH_INFO: `/v3/domains/0632740a83c6469f8e0ab9c5b7e16d81` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:43.705236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d512b4-4ad6-4ccc-8ddb-ea3f5b3cf2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0632740a83c6469f8e0ab9c5b7e16d81)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:43.706645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d512b4-4ad6-4ccc-8ddb-ea3f5b3cf2f4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:43.708322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 598/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Thu Jun 16 20:16:43 2022] GET /identity/v3/domains/0632740a83c6469f8e0ab9c5b7e16d81 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:43.713894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:43.766812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:43.809192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad284aa0-0ac4-46ab-b5d7-a95bc190dc48 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:43.842419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e176c0d-72f3-494d-94c1-5cecb01eb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:43.843072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e176c0d-72f3-494d-94c1-5cecb01eb773 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:43.843350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e176c0d-72f3-494d-94c1-5cecb01eb773 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:43.843621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e176c0d-72f3-494d-94c1-5cecb01eb773 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:43.844325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e176c0d-72f3-494d-94c1-5cecb01eb773 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:43.845773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e176c0d-72f3-494d-94c1-5cecb01eb773 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:43.937595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 579/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:16:43 2022] POST /identity/v3/users => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:16:46.046472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7e49-730f-4e9c-ab24-9bbcaa47dbf3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:46.047027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7e49-730f-4e9c-ab24-9bbcaa47dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:46.047027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b7e49-730f-4e9c-ab24-9bbcaa47dbf3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:46.048401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 599/1178] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:46.054276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:46.054697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:46.054836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:46.071954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:46.073173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:46.137499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 580/1179] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:16:46.161228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7e49-730f-4e9c-ab24-9bbcaa47dbf3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:46.260153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b7e49-730f-4e9c-ab24-9bbcaa47dbf3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:46.280133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:46.293770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:46.294545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:46.294829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:46.295102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:46.305446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:46.313236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:46.314393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:46.315476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:46.316759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 600/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:46.320595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:46.360787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:46.416351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afb3f0-e0a6-444e-bb31-d7767ae5d28d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:46.449205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:46.449854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:46.450130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:46.450401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:46.451138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:46.451442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:46.452828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:46.461100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 581/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:46.466954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:46.564091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9fa7a-f96f-4eaf-b68b-0d1285d1f824 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:46.596837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:46.597689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:46.597970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:46.598243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] PATH_INFO: `/v3/users/432f0e2cae8c4853b4ec9af6ba669b26` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:46.610861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] RBAC: Authorizing `identity:get_user(user_id=432f0e2cae8c4853b4ec9af6ba669b26)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:46.612289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:46.613954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 601/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:46 2022] GET /identity/v3/users/432f0e2cae8c4853b4ec9af6ba669b26 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:46.620272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:46.725714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097defd7-b7b5-4b05-b32e-eddf04251e1b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:46.727203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:46.758917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:46.759569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:46.760033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:46.760324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:46.824877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:46.826254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:46.919957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 582/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:16:46.925813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:46.968125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:47.024544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42f151-d059-4c99-8df1-41ceb122e605 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:47.056251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988993c0-0e56-4a80-bd44-c4757d88bc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:47.057129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988993c0-0e56-4a80-bd44-c4757d88bc17 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:47.057409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988993c0-0e56-4a80-bd44-c4757d88bc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:47.057682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988993c0-0e56-4a80-bd44-c4757d88bc17 None admin] PATH_INFO: `/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:47.058850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988993c0-0e56-4a80-bd44-c4757d88bc17 None admin] RBAC: Authorizing `identity:get_project(project_id=b23ae2c25edd45868b4f1624cef5a7a3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:47.060256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988993c0-0e56-4a80-bd44-c4757d88bc17 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:47.061995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 602/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:46 2022] GET /identity/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:47.068079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:47.070761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:47.163734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4745ad-2055-4960-9fbf-11a4dd55f3af None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:47.195103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:47.195738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:47.196014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:47.196281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:47.197130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=b23ae2c25edd45868b4f1624cef5a7a3, user.id=432f0e2cae8c4853b4ec9af6ba669b26) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:47.197438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:47.198835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1411ac3-b7c3-4b26-85b9-a7ce76f041b4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:47.204306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 583/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:47 2022] GET /identity/v3/role_assignments?user.id=432f0e2cae8c4853b4ec9af6ba669b26&scope.project.id=b23ae2c25edd45868b4f1624cef5a7a3&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:49.284181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6ec2-a778-4d51-85ac-c7b8c65852bf None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:49.284764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6ec2-a778-4d51-85ac-c7b8c65852bf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:49.284764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6ec2-a778-4d51-85ac-c7b8c65852bf None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:49.286148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 603/1186] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:49.291304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:49.291671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:49.291862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:49.308034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:49.309229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:49.366416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:49.373607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 584/1187] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:49.396250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a6ec2-a778-4d51-85ac-c7b8c65852bf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:49.492844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a6ec2-a778-4d51-85ac-c7b8c65852bf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:49.499947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:49.525574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:49.526338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:49.526618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:49.526892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:49.539445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:49.544496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:49.545617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:16:49.546724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 604/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:49.552005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:49.648304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a291f84-558a-45e1-aedd-286c95b29c3a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:49.681011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:49.681695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:49.682028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:49.682306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:49.683093 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:49.683399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:49.684850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:49.692575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 585/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:49.698956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:49.793939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c139341-f278-4588-a4dd-23fcfc86e0ef None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:49.826407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:49.827251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:49.827535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:49.827811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] PATH_INFO: `/v3/users/432f0e2cae8c4853b4ec9af6ba669b26` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:49.829018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] RBAC: Authorizing `identity:get_user(user_id=432f0e2cae8c4853b4ec9af6ba669b26)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:49.830449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:49.832063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 605/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:49 2022] GET /identity/v3/users/432f0e2cae8c4853b4ec9af6ba669b26 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:49.837672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:49.893332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:49.932662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f726596-ac56-4d02-96c6-890d57c356c2 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:49.964464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0c36e-3147-4f2f-8a6b-ac31a23d5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:49.965324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0c36e-3147-4f2f-8a6b-ac31a23d5797 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:49.965605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0c36e-3147-4f2f-8a6b-ac31a23d5797 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:49.965877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0c36e-3147-4f2f-8a6b-ac31a23d5797 None admin] PATH_INFO: `/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:49.967026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0c36e-3147-4f2f-8a6b-ac31a23d5797 None admin] RBAC: Authorizing `identity:get_project(project_id=b23ae2c25edd45868b4f1624cef5a7a3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:49.968435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0c36e-3147-4f2f-8a6b-ac31a23d5797 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:49.970121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 586/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:49 2022] GET /identity/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:49.975990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:50.010208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:50.076884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29359eb7-4fec-4194-a8fc-0957733deeb2 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:50.110085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec310fb6-67dd-4348-9fba-95a8d721cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:50.110963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec310fb6-67dd-4348-9fba-95a8d721cf98 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:50.111248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec310fb6-67dd-4348-9fba-95a8d721cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:50.111524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec310fb6-67dd-4348-9fba-95a8d721cf98 None admin] PATH_INFO: `/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3/users/432f0e2cae8c4853b4ec9af6ba669b26/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:50.113511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec310fb6-67dd-4348-9fba-95a8d721cf98 None admin] RBAC: Authorizing `identity:create_grant(project_id=b23ae2c25edd45868b4f1624cef5a7a3, user_id=432f0e2cae8c4853b4ec9af6ba669b26, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:50.114918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec310fb6-67dd-4348-9fba-95a8d721cf98 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:50.175706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 606/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:16:49 2022] PUT /identity/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3/users/432f0e2cae8c4853b4ec9af6ba669b26/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:16:52.272372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db955-b4fa-472e-bfe2-d9d566b0d315 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:52.272954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db955-b4fa-472e-bfe2-d9d566b0d315 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:52.272954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db955-b4fa-472e-bfe2-d9d566b0d315 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:52.274315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 587/1193] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:16:52.280060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:52.280427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:52.280635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:52.296897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:16:52.298075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:16:52.362780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 607/1194] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:16:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:16:52.386938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9db955-b4fa-472e-bfe2-d9d566b0d315 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:52.485061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9db955-b4fa-472e-bfe2-d9d566b0d315 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:52.509874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:52.518032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:52.518800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:52.520749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:52.520749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:52.529674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:16:52.537202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:16:52.538324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:16:52.544388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 588/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:16:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:16:52.545833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:52.568427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:52.639741 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cb3bc-1bb7-40fd-b162-ac2af09cb96f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:52.671525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:52.672178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:52.672462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:52.672769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:52.673515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:52.673823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:52.675174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:52.683412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 608/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:52.689192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:52.785091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6610af7-f414-44fd-b3af-81e00e650fe5 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:52.816983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:52.817831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:52.818116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:52.818394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] PATH_INFO: `/v3/users/432f0e2cae8c4853b4ec9af6ba669b26` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:52.819581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] RBAC: Authorizing `identity:get_user(user_id=432f0e2cae8c4853b4ec9af6ba669b26)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:52.821168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:52.822823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 589/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Thu Jun 16 20:16:52 2022] GET /identity/v3/users/432f0e2cae8c4853b4ec9af6ba669b26 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:52.828714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:52.910818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:52.925120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb065f80-c0f3-4e56-9a46-4c5a8455b484 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:52.956987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:52.957611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:52.957894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:52.958167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:53.021711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:53.023149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:53.101346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:53.115672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 609/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:16:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 20:16:53.121590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:53.174696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:16:53.217732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ccaa6-9c99-4efd-9a30-5c2b6d9f3c94 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:53.248986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623d34f-a7c2-4166-9db2-e4509c7b7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:53.249829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623d34f-a7c2-4166-9db2-e4509c7b7b1a None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:53.250109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623d34f-a7c2-4166-9db2-e4509c7b7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:53.250381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623d34f-a7c2-4166-9db2-e4509c7b7b1a None admin] PATH_INFO: `/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:53.251544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623d34f-a7c2-4166-9db2-e4509c7b7b1a None admin] RBAC: Authorizing `identity:get_project(project_id=b23ae2c25edd45868b4f1624cef5a7a3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:53.252991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623d34f-a7c2-4166-9db2-e4509c7b7b1a None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:53.254665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 590/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Thu Jun 16 20:16:53 2022] GET /identity/v3/projects/b23ae2c25edd45868b4f1624cef5a7a3 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:16:53.261247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:16:53.355470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eb468-c5e5-40a2-9e6f-4345e07abcc7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:16:53.388392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:16:53.389050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:16:53.389333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:16:53.389606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:16:53.390428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=b23ae2c25edd45868b4f1624cef5a7a3, user.id=432f0e2cae8c4853b4ec9af6ba669b26) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:16:53.390766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:16:53.392179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0022a-fed6-440f-89e8-e2b19ae274ae None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:16:53.398000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 610/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:16:53 2022] GET /identity/v3/role_assignments?user.id=432f0e2cae8c4853b4ec9af6ba669b26&scope.project.id=b23ae2c25edd45868b4f1624cef5a7a3&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:17:03.244962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=39 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:17:03.395205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=75 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:18.703223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542d2a-8015-4804-a9db-9cbb888920a1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:18.703807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542d2a-8015-4804-a9db-9cbb888920a1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:18.703807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2542d2a-8015-4804-a9db-9cbb888920a1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:18.705253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 591/1201] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:18.710582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:18.711022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:18.711147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:18.727986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:18.729188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:18.793442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 611/1202] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:18.817866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542d2a-8015-4804-a9db-9cbb888920a1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:18.917824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2542d2a-8015-4804-a9db-9cbb888920a1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:18.949756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:18.951307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:18.951307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:18.951307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:18.961456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:18.962889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:18.980224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:18.982999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:18.984199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:18.984199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:18.984199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:18.984199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:18.984199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 592/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:18.987544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:19.085069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3182731-38d0-472a-860e-6a9f0851f122 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:19.112390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:19.118034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:19.118691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:19.118983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:19.119255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:19.119982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:19.120288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:19.121685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a8e40-c649-48c9-b9c7-5dddd650ca29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:19.139739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 612/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:19.146467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:19.198648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:19.243354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597760c-81a7-407d-982a-8f39d93a2f2d None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:19.275666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dac23-1026-4890-b4b5-8a54bced0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:19.276313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dac23-1026-4890-b4b5-8a54bced0050 None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:19.276595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dac23-1026-4890-b4b5-8a54bced0050 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:19.276910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dac23-1026-4890-b4b5-8a54bced0050 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:19.277600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dac23-1026-4890-b4b5-8a54bced0050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:19.279061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dac23-1026-4890-b4b5-8a54bced0050 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:19.457322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 593/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Thu Jun 16 20:18:19 2022] POST /identity/v3/users => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:18:21.597800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6cb7-94d3-4452-b938-c80c745f98ec None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:21.598364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6cb7-94d3-4452-b938-c80c745f98ec None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:21.598364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f6cb7-94d3-4452-b938-c80c745f98ec None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:21.599722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 613/1206] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:21.605392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:21.605840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:21.605941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:21.622941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:21.624153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:21.690711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 594/1207] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:21.716062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f6cb7-94d3-4452-b938-c80c745f98ec None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:21.815498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f6cb7-94d3-4452-b938-c80c745f98ec None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:21.851137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:21.851918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:21.852202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:21.852475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:21.862576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:18:21.870267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:21.871404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:21.872773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 614/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:18:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:21.877557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:21.916272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:21.973653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c5c2c-de92-4d14-92b3-248231fe235d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:22.006196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:22.006850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:22.007127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:22.007399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:22.008138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:22.008439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:22.009820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:22.017778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 595/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:22.023513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:22.072094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:22.125150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76435067-10ce-4bcc-b2fe-abc7eb6cc607 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:22.159869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:22.160819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:22.161108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:22.161393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:22.173587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:22.180450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:22.192418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:22.193507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:22.194690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:22.194690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:22.194690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:22.194690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:22.194690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 615/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:22.199451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:22.293568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:22.296449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf638252-9ded-45f2-a517-45691dc3e1df None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:22.330875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:22.331457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:22.331734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:22.332004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:22.332743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:22.333044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:22.334635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:22.345590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 596/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:22.351233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:22.447531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ef209-c18e-40b2-ae53-a3143a11a24d None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:22.449029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:22.481721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:22.482509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:22.482788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:22.483059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:22.489867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:22.491280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:18:22.507767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:22.513865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:22.515048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 616/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:22.516378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:22.613717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac7500-af6b-4755-9c2f-9b46b414f054 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:22.646303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:22.646954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:22.647230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:22.647499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:22.648319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:22.648638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:22.650138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:22.666710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 597/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jun 16 20:18:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:22.673001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:22.769930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2a018-21db-4018-bcbf-ad17d05b21b6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:22.802096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:22.806611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:22.806611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:22.806611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:22.831393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:22.875366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:22.875366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:22.964533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 617/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:18:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:18:22.971017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:22.989922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:23.067740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca460073-8c39-47e6-8454-003e25c63bc6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:23.100149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:23.100999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:23.114228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:23.114228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:23.114228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:23.114228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:23.130308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:23.131334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:23.132260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:23.132260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:23.132260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:23.132260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:23.132260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 598/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:23.137238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:23.197994 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:23.235662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bc38f-f7ba-49f8-886e-dbf7462b2e6a None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:23.267604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:23.268252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:23.268530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:23.268830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:23.269538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:23.269839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:23.271195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:23.282948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 618/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:23.288835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:23.383471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e5528-f9e4-45f0-9f91-8d51eded9436 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:23.406547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:23.418822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:23.419604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:23.419883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:23.420155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:23.426623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:23.428179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:18:23.441759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:23.456520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:23.457652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 599/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:23.458267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:23.546667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64c91a-d061-4c2e-82a6-3c68bc46b5c8 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:23.568506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:23.579955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:23.580601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:23.580945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:23.581245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:23.582022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:23.582330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:23.584000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529c4ab-b4dd-4cc8-b2c4-fa9221c935f8 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:23.595646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 619/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:18:23.604428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:23.698047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500f0b-6cde-43ac-a3c4-ca21b2859c2e None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:23.728504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:23.734821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:23.735486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:23.735765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:23.736144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:23.737041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=31897a7b7dda4dc1be1ee7a0d32bdd81) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:23.737353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:23.738778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab6eb3-85a9-4474-9e72-2cb8c255a5e6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:23.745261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 600/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:18:23 2022] GET /identity/v3/role_assignments?user.id=31897a7b7dda4dc1be1ee7a0d32bdd81&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:25.845047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95045a-e3d4-4f9f-8864-523f7dd7faa1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:25.845568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95045a-e3d4-4f9f-8864-523f7dd7faa1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:25.845568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95045a-e3d4-4f9f-8864-523f7dd7faa1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:25.846889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 620/1220] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:25.852021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:25.852433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:25.852604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:25.868947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:25.870116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:25.934733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 601/1221] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:25.958358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95045a-e3d4-4f9f-8864-523f7dd7faa1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:26.079191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95045a-e3d4-4f9f-8864-523f7dd7faa1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:26.116581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:26.117378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:26.117659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:26.117945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:26.128244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:18:26.136121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:26.141685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:26.142747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 621/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:18:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:26.144172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:26.240926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca951f3-8625-4e6d-b81c-ef73d2a2de29 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:26.263658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:26.274397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:26.275062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:26.275345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:26.275620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:26.276362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] RBAC: Adding query filter params (name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:26.276689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:26.278085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:26.285780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 602/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:18:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:18:26.291604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:26.335293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:26.389673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6442-23a2-4672-aabb-6c68b69a56c0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:26.423538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:26.424323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:26.424608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:26.424914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:26.434570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:26.436013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:26.453466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:26.457435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:26.458790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:26.458790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:26.458790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:26.458790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:26.458790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 622/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:26.462107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:26.556588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b87ffb-6e84-41ae-911e-83c3fc31529c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:26.590056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:26.590705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:26.590988 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:26.591263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:26.591985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:26.592293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:26.593771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:26.605095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 603/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:26.611364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:26.701874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:26.711509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf57b0-4148-41c2-8e3b-bb2a0b083a47 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:26.744438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:26.745397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:26.745683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:26.745958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:26.753174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:26.754597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:18:26.768784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:26.769900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:26.771040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 623/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:26.775870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:26.821405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:26.871955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e1d0a-7e86-46ca-9184-5f68e1f0af5f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:26.903215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:26.903873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:26.904157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:26.904434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:26.905296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:26.906120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:26.907538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:26.924288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 604/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jun 16 20:18:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:26.930004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:27.029284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f99f-2c13-4eec-8d54-92e486cf23a3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:27.063702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:27.064484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:27.064800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:27.065077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:27.075184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:27.080737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:27.094049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:27.095146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:27.096434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:27.096434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:27.096434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:27.096434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:27.096434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 624/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:27.101008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:27.205616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7c659-dd41-400e-ac47-2dc487b61d6c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:27.207928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:27.238525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:27.239172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:27.239518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:27.239796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:27.240511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:27.240842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:27.242189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:27.253563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 605/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:27.259236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:27.268020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:27.355194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28008-76d4-4d6a-9b43-d35a98e2cf25 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:27.388163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:27.388968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:27.389249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:27.389524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:27.395952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:27.397414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:18:27.411329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:27.412412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:27.413425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 625/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:27.418469 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:27.516016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc8c8-406a-4149-9f3a-ab48865d7401 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:27.549607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:27.550257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:27.550564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:27.550840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:27.551629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:27.551934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:27.555352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75531064-35cd-4114-9649-3d5c8a856a7d None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:27.569102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 606/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:27.575014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:27.639004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:27.678446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed579a3-e1a5-49a9-af03-f792abdda741 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:27.717641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946c312-b509-4448-b490-e29095fdaa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:27.718696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946c312-b509-4448-b490-e29095fdaa88 None admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:27.718973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946c312-b509-4448-b490-e29095fdaa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:27.719248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946c312-b509-4448-b490-e29095fdaa88 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/31897a7b7dda4dc1be1ee7a0d32bdd81/roles/ec957b0d46ef4c5a839a3ab4d32092fb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:27.733215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946c312-b509-4448-b490-e29095fdaa88 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=31897a7b7dda4dc1be1ee7a0d32bdd81, role_id=ec957b0d46ef4c5a839a3ab4d32092fb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:27.734668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946c312-b509-4448-b490-e29095fdaa88 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:27.852547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 626/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:18:27 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/31897a7b7dda4dc1be1ee7a0d32bdd81/roles/ec957b0d46ef4c5a839a3ab4d32092fb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:18:29.942929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d8ba-77eb-40e7-a302-fb733eb420bd None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:29.943486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d8ba-77eb-40e7-a302-fb733eb420bd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:29.943486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d8ba-77eb-40e7-a302-fb733eb420bd None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:29.944920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 607/1233] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:29.950023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:29.950436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:29.950594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:29.967826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:29.969048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:30.039288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 627/1234] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:30.063572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d8ba-77eb-40e7-a302-fb733eb420bd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:30.088427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:30.168848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d8ba-77eb-40e7-a302-fb733eb420bd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:30.202849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:30.203612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:30.209809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:30.219927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:30.220027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:18:30.227647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:30.228757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:30.229936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 608/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Thu Jun 16 20:18:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:30.235584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:30.280149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:30.331581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f214dce-4bcb-4c29-9ed2-1a4a48c98181 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:30.364734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:30.380589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:30.380589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:30.380589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:30.380589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] RBAC: Adding query filter params (name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:30.380589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:30.380589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:30.381124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 628/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Thu Jun 16 20:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:30.381853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:30.463175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:30.477685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4f212-a373-4aa4-a63c-5336a1c4af10 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:30.510283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:30.511053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:30.511335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:30.511606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:30.521791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:30.523264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:30.540185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:30.541222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:30.542120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:30.542120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:30.542120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:30.542120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:30.542120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 609/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:30.547309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:30.643234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a429cb8-8876-45fb-84c1-1583cf8e6843 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:30.651556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:30.675977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:30.676640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:30.676934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:30.677215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:30.677926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:30.678230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:30.679581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:30.690701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 629/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:30.696748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:30.792213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63959e2-16a4-4875-baa3-bc253df7fe65 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:30.824543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:30.825351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:30.825631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:30.825903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:30.829047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:30.833657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:30.835068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:18:30.850098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:30.851247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:30.852258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 610/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:30.857142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:30.951070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414e7ef-1ae3-4d05-9697-b2885b31f0f1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:30.986993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:30.987653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:30.987945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:30.988225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:30.989089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:30.989400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:30.990811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:31.007926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 630/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jun 16 20:18:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:31.013828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:31.109383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a12fa-3f5b-465b-91d6-372fea5a18f4 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:31.142517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:31.143150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:31.143434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:31.143715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:31.203471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:31.210119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:31.211575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:31.304595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 611/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:18:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:18:31.310411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:31.336935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:31.404639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f386aec-e7f3-47b8-b22b-4ce6d5670fdd None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:31.437042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:31.437816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:31.438097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:31.438368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:31.448910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:31.450451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:31.468550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:31.469728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:31.470851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:31.470851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:31.470851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:31.470851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:31.470851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 631/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:31.475546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:31.574676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:31.580811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333c999-9964-4cf2-9f0d-6042da6485c0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:31.613456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:31.614117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:31.614384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:31.614661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:31.615379 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:31.615684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:31.617078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:31.627725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 612/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:31.633514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:31.711431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:31.732170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c406-2185-4707-ab3d-ebdf76d07cfc None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:31.764304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:31.765621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:31.765904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:31.766180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:31.772592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:31.774060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:18:31.787959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:31.789048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:31.789976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 632/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:18:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:31.795147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:31.891412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77d15a-6d43-4b1b-b044-9dca718d534f None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:31.923733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:31.924382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:31.924753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:31.925028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:31.925811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:31.926117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:31.927533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559e05b-9c1c-4cda-b7ae-c48121028eb2 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:31.939621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 613/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:18:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:31.945560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:32.043576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19622b-3e35-48d0-9aea-db1ab71b54d4 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:32.076254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:32.077475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:32.077769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:32.078048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:32.078877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] RBAC: Adding query filter params (role.id=ec957b0d46ef4c5a839a3ab4d32092fb, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=31897a7b7dda4dc1be1ee7a0d32bdd81) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:32.079189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:32.080663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6c042-fe7c-43f9-97be-87244c774022 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:32.086672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 633/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:18:31 2022] GET /identity/v3/role_assignments?user.id=31897a7b7dda4dc1be1ee7a0d32bdd81&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=ec957b0d46ef4c5a839a3ab4d32092fb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:18:34.245368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e331d-1f61-48c3-bf93-7bf775745133 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:34.245906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e331d-1f61-48c3-bf93-7bf775745133 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:34.245906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e331d-1f61-48c3-bf93-7bf775745133 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:34.247317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 614/1247] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:34.252959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:34.253380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:34.259884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:34.259884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:34.270936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:34.272112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:34.336826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 634/1248] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:34.359706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e331d-1f61-48c3-bf93-7bf775745133 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:34.378146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:34.457620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e331d-1f61-48c3-bf93-7bf775745133 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:34.489675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:34.490488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:34.490905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:34.491824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:34.502153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:18:34.509533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:34.510645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:34.511883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 615/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:34.517308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:34.613529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461db2a-d993-44b3-8989-c902403d1d70 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:34.641685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:34.646508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:34.647163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:34.647446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:34.647722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:34.648461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:34.648797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:34.650142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:34.658033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 635/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:34.663997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:34.740624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:34.762236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8f0280-e85e-4c99-9f36-cc721e69ce4b None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:34.795327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:34.796154 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:34.796465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:34.796769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:34.806572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:34.808042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:34.824920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:34.825975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:34.827812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:34.827812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:34.827812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:34.827812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:34.827812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 616/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:34.832561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:34.928896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64040fd-c7ed-4da9-a224-ac8369f57858 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:34.961645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:34.962296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:34.962572 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:34.962840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:34.963548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:34.963849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:34.965264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:34.976684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 636/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:34.982353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:35.079826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801934c-49f9-476b-a6cb-4906383f82e7 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:35.105251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:35.112816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:35.113601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:35.113885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:35.114153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:35.121116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:35.122540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:18:35.137237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:35.138169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:35.139181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 617/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:35.144883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:35.197856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:35.242103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c317d3-4f4c-45db-9804-5d53c5f40a68 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:35.290689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:35.291668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:35.292092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:35.292512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:35.293895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:35.294408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:35.296497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:35.319808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 637/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jun 16 20:18:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:35.325648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:35.423845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c59b5-21ff-4e13-94cb-68f5e2d8b4a8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:35.472447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:35.473113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:35.473393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:35.473664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:35.527689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:35.540731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:35.542173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:35.646488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 618/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:18:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:18:35.652308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:35.749496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74abda-13e0-48b0-888e-0f4ee7d59e54 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:35.761899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:35.782243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:35.783020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:35.783304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:35.783581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:35.793207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:35.794640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:35.812292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:35.823135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:35.824244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:35.824244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:35.824244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:35.824244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:35.824244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 638/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:35.824605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:35.904303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:35.917237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346971-fc2d-44f0-b1a4-f61196ec8910 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:35.950893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:35.951607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:35.951890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:35.952163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:35.952926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:35.953224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:35.954926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:35.969431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 619/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:35.975044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:36.071851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ae51-ce84-4fda-ac16-856ef3ca5df3 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:36.105335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:36.106122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:36.106407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:36.106682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:36.113200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:36.117815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:18:36.127958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:36.129068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:36.130333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 639/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:18:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:36.137003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:36.237590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d712c6-9f7c-4d33-9c6c-7d8a29822414 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:36.270015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:36.270667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:36.270943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:36.271212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:36.272048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:36.272397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:36.273902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd979505-21c3-48d1-b06e-dafcd83951ec None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:36.286962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 620/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:18:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:18:36.293054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:36.318120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:36.390751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa572f6f-4b3f-4da5-bf92-e68af8dbebc0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:36.422997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:36.426294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:36.426294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:36.426294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:36.426294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=31897a7b7dda4dc1be1ee7a0d32bdd81) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:36.426294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:36.426716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876452ee-7957-4ded-a362-76ad496e015f None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:36.431934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 640/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:18:36 2022] GET /identity/v3/role_assignments?user.id=31897a7b7dda4dc1be1ee7a0d32bdd81&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:38.543666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272faee5-2a2f-4bb2-9e18-b52ece5127df None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:38.543666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272faee5-2a2f-4bb2-9e18-b52ece5127df None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:38.544143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272faee5-2a2f-4bb2-9e18-b52ece5127df None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:38.545176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 621/1261] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:38.550345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:38.550750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:38.550906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:38.567254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:38.568432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:38.633835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 641/1262] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:38.657609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272faee5-2a2f-4bb2-9e18-b52ece5127df None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:38.668448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:38.755378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272faee5-2a2f-4bb2-9e18-b52ece5127df None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:38.788487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:38.789297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:38.789582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:38.789864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:38.805104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:18:38.808348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:38.809451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:38.810327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 622/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:18:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:38.816353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:38.834943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:38.933345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813891f6-bcfb-4c59-9cf0-b293c6f7119a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:38.970135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:38.970781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:38.971059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:38.971374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:38.972114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:38.972474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:38.973854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:38.981650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 642/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:38.987480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.054776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:39.087067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1947225-26a9-4eac-83fe-bfc8cd1239f0 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:39.118982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:39.119756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:39.120038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:39.120308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:39.131078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:39.132499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:39.148894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:39.149780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:39.150866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:39.150866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:39.150866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:39.150866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:39.150866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 623/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:39.155917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.235335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:39.253672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028534b-21c4-44d0-b5df-4063778d02e7 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:39.285106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:39.285750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:39.286029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:39.286300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:39.287015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:39.287318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:39.288673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:39.302214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 643/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:39.308154 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.409078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d18138-95d7-455f-8ce4-951a0b59fe13 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:39.427919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:39.441609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:39.442403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:39.442684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:39.442959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:39.450089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:39.466798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:39.468351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:39.469547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 624/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:39.473063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.569267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4778f3-1dd8-4d33-8569-6e257cb2d690 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:39.603224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:39.615937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:39.615937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:39.615937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:39.615937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:39.615937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:39.615937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:39.616765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:39.624389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 644/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jun 16 20:18:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:39.630051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.730324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a9472-67c8-4a79-ab36-0e97de89cf35 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:39.797822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:39.797822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:39.797822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:39.797822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:39.798212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:39.799069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:39.800281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 625/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:39.801044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.894911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc406ac-b3df-4cc7-911b-c101ef7a1fe1 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:39.927949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:39.928590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:39.928919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:39.929192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:39.929904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:39.930207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:39.931605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:39.942451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 645/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:18:39.948195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:39.980003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:40.044345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ca669-82be-4b61-ae7f-4ae3831fa2a3 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:40.076225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:40.077519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:40.077859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:40.078126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:40.084784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:40.086199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:18:40.100340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:40.101426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:40.102606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 626/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:40.107507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:40.163690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:40.204651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9e7bc-2a0c-41f1-8765-6c4d07240d9e None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:40.235941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:40.236584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:40.236899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:40.237168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:40.237935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:40.238236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:40.239625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe0a45-ce8b-4863-904e-16e63b0583d2 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:40.251782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 646/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:40.257926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:40.346223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:40.354994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf828e6-dbeb-4b3c-88c4-620dbb06b1d8 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:40.387846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5fc017-8dfe-44ea-8acf-fa68bedd0ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:40.388834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fc017-8dfe-44ea-8acf-fa68bedd0ad4 None admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:40.389123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fc017-8dfe-44ea-8acf-fa68bedd0ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:40.393998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5fc017-8dfe-44ea-8acf-fa68bedd0ad4 None admin] PATH_INFO: `/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/31897a7b7dda4dc1be1ee7a0d32bdd81/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:40.395933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fc017-8dfe-44ea-8acf-fa68bedd0ad4 None admin] RBAC: Authorizing `identity:create_grant(project_id=87cfcb21b7554cb0b5a7a8e3a20fb149, user_id=31897a7b7dda4dc1be1ee7a0d32bdd81, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:40.397400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5fc017-8dfe-44ea-8acf-fa68bedd0ad4 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:40.486739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 627/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Thu Jun 16 20:18:40 2022] PUT /identity/v3/projects/87cfcb21b7554cb0b5a7a8e3a20fb149/users/31897a7b7dda4dc1be1ee7a0d32bdd81/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:18:42.617580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3aa84-f1bc-44ad-9149-8a63470155b1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:42.618123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3aa84-f1bc-44ad-9149-8a63470155b1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:42.618223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3aa84-f1bc-44ad-9149-8a63470155b1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:42.619551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 647/1274] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:42.624681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:42.625117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:42.625227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:42.641403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:42.642582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:42.707254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 628/1275] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 20:18:42.731362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3aa84-f1bc-44ad-9149-8a63470155b1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:42.829297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3aa84-f1bc-44ad-9149-8a63470155b1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:42.846291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:42.861991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:42.862762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:42.863044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:42.863319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:42.872834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 20:18:42.880437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:42.881697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:42.882583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 648/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Thu Jun 16 20:18:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:42.887624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:42.968785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:42.986105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eafe43-3088-41bb-9d47-1669f0ed3e30 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:43.019300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:43.019982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:43.020284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:43.020556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:43.021329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:43.021683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:43.023093 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:43.030758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 629/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Thu Jun 16 20:18:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:43.036670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:43.133376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841e4bc-4062-4a59-8f0a-1fd0a4379bc0 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:43.166104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:43.169308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:43.169308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:43.169308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:43.178250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:43.179679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:43.197219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:43.198286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:43.199251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:43.199251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:43.199251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:43.199251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:43.199251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 649/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:43.204355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:43.318123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76d6f18-fc8d-44ad-b2a0-28c911b9d58c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:43.350305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:43.353718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:43.353718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:43.353718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:43.353718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:43.353718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:43.354124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:43.365787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 630/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:43.371436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:43.404411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:43.470584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76245c18-f6ae-4ac8-8760-0387a60d6bfa None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:43.504229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:43.505044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:43.505327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:43.505601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:43.512349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:43.513861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 20:18:43.527993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:43.536596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:43.537891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 650/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:43.538687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:43.539985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:43.630952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e4784-c963-4ef4-a9a4-44498d3cd529 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:43.672795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:43.673457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:43.673741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:43.674018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:43.674850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:43.675162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:43.676578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:43.693558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 631/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Thu Jun 16 20:18:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:43.699283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:43.787738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:43.796854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b6cf9-5efb-4c97-a7a1-406c8b0c7037 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:43.828996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:43.829631 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:43.829928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:43.830182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:43.894035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:43.895470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:43.987958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:43.997778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 651/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Thu Jun 16 20:18:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 20:18:44.004135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:44.063984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:44.101126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77843e0-3c97-4106-9ec0-9c179aeb3e7c None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:44.132592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:44.133396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:44.133676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:44.133948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:44.144455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:44.145913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 20:18:44.164694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:44.165647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:44.166847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 20:18:44.166847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 20:18:44.166847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 20:18:44.166847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:44.166847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 632/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:44.171771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:44.268698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07612c-a1d0-4a7e-a820-e384cfa48190 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:44.300996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:44.301667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:44.301945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:44.302220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:44.302981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:44.303283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:44.304647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:44.316460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 652/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Thu Jun 16 20:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:44.322380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:44.419804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc19650-ca93-4124-a615-ea70d96548f6 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:44.432745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:44.451446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:44.452766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:44.453052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:44.453332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:44.459967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:44.461518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 20:18:44.476444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:44.477563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: ERROR keystone.server.flask.application Jun 16 20:18:44.478699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 633/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Thu Jun 16 20:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:44.483516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:44.532865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:44.580879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610b097-db87-4fcb-8b24-0e2a9be345c6 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:44.613130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:44.618348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:44.618348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:44.618348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:44.618348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:44.618348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:44.618348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daec5f9-28b3-4828-8bcf-fe08078f8856 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:44.629600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 653/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Thu Jun 16 20:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:44.635842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:44.731692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ddb32-e8f7-4df4-8781-1319883f2998 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:44.764141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:44.764827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:44.765109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:44.765498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:44.766326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] RBAC: Adding query filter params (role.id=c58525d5c30b4bd58cc4150c24ac8d68, scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149, user.id=31897a7b7dda4dc1be1ee7a0d32bdd81) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:44.766636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:44.768072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4facda49-9fc6-4793-af21-714db16e22d0 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:44.774041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 634/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Thu Jun 16 20:18:44 2022] GET /identity/v3/role_assignments?user.id=31897a7b7dda4dc1be1ee7a0d32bdd81&scope.project.id=87cfcb21b7554cb0b5a7a8e3a20fb149&role.id=c58525d5c30b4bd58cc4150c24ac8d68 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:46.884976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4ae0-10e4-435c-9919-813492d13676 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:46.885487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4ae0-10e4-435c-9919-813492d13676 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:46.885487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4ae0-10e4-435c-9919-813492d13676 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:46.886819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 654/1288] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:46.892056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:46.892461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:46.892648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:46.908936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:46.910110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:46.939346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:46.976221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 635/1289] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:46.998777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4ae0-10e4-435c-9919-813492d13676 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:47.097789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4ae0-10e4-435c-9919-813492d13676 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:47.108010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:47.130371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:47.131151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:47.131428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:47.131697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:47.132342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:47.133757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:47.145834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:47.147036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:47.148234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 655/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:18:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:47.152922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:47.254560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49a3cc-6a0a-4e71-8be5-f0cce8767629 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:47.286984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:47.287638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:47.287920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:47.288196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:47.288925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:47.289229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:47.290666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc91ee4-f8dd-4e06-916a-5b1f35cac6cb None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:47.295346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 636/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jun 16 20:18:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:47.301629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:47.396648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3726f435-cc6e-4771-82c4-797ba41e1716 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:47.428286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:47.428965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:47.429277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:47.429553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] PATH_INFO: `/v3/services` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:47.430255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] RBAC: Adding query filter params (type=placement) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:47.430568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:47.431918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d7e8b-f510-41f2-b295-f0142394234b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:47.436180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 656/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jun 16 20:18:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:49.643139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb588c2-95cd-4553-ae86-d1ef89362aa7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:49.643694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb588c2-95cd-4553-ae86-d1ef89362aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:49.643694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb588c2-95cd-4553-ae86-d1ef89362aa7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:49.645107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 637/1293] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:49.651070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441fa1-6d66-4ba4-b96d-a5c5b55ffb3c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:49.651546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441fa1-6d66-4ba4-b96d-a5c5b55ffb3c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:49.651640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9441fa1-6d66-4ba4-b96d-a5c5b55ffb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:49.668784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e9441fa1-6d66-4ba4-b96d-a5c5b55ffb3c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:49.669975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e9441fa1-6d66-4ba4-b96d-a5c5b55ffb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:49.698299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:49.734235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 657/1294] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:49.756787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb588c2-95cd-4553-ae86-d1ef89362aa7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:49.788146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:49.855325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb588c2-95cd-4553-ae86-d1ef89362aa7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:49.886870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12484d6e-ea41-4d09-9380-e2cad36fea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:49.887518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484d6e-ea41-4d09-9380-e2cad36fea6f None admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:49.887802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484d6e-ea41-4d09-9380-e2cad36fea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:49.888079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484d6e-ea41-4d09-9380-e2cad36fea6f None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:49.888837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484d6e-ea41-4d09-9380-e2cad36fea6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:49.890708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484d6e-ea41-4d09-9380-e2cad36fea6f None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:50.007481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 638/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Thu Jun 16 20:18:49 2022] POST /identity/v3/services => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:18:52.138199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c4e9-8677-4bb4-87dc-557b1cde94cd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:52.138762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c4e9-8677-4bb4-87dc-557b1cde94cd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:52.138762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c4e9-8677-4bb4-87dc-557b1cde94cd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:52.140193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 658/1296] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:52.145806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:52.146227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:52.146397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:52.163415 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:52.164639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:52.235362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 639/1297] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:52.259070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c4e9-8677-4bb4-87dc-557b1cde94cd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:52.355581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c4e9-8677-4bb4-87dc-557b1cde94cd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:52.388369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:52.389106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:52.389522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:52.389816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:52.390482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:52.392362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:52.403962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:52.405213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:52.406200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 659/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:18:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:52.411306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:52.428949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:52.505855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8497f-f4d3-44b7-a248-135019c4dfbe None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:52.539709 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:52.540362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:52.540661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:52.540935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:52.541635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:52.542077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:52.543599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:52.549439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 640/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jun 16 20:18:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:52.555431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:52.587247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:52.652308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc39d1-3bce-4de1-b0ff-d238b6e10e45 None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:52.684991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:52.685625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:52.685909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:52.686249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:52.687034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] RBAC: Adding query filter params (interface=public, service_id=d144b68aabf34c1b825b2115ca7e80a5, region_id=RegionOne) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:52.687343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:52.689268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9630252-b2b7-4230-be82-be1abd4d1f29 None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:52.694224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 660/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Thu Jun 16 20:18:52 2022] GET /identity/v3/endpoints?service_id=d144b68aabf34c1b825b2115ca7e80a5&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:52.700066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:52.778439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:52.795693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4854351-3905-4dc8-b68e-ca05dd676d99 None admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:52.828097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87a317-1c37-45b1-8ece-eb64839da1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:52.828767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87a317-1c37-45b1-8ece-eb64839da1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:52.829049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87a317-1c37-45b1-8ece-eb64839da1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:52.829321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87a317-1c37-45b1-8ece-eb64839da1d9 None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:52.830133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87a317-1c37-45b1-8ece-eb64839da1d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:52.831483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87a317-1c37-45b1-8ece-eb64839da1d9 None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:52.838475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 641/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Thu Jun 16 20:18:52 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:18:54.938410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d770f-c0a9-411d-a11c-1996a2863e32 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:54.939067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d770f-c0a9-411d-a11c-1996a2863e32 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:54.939067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d770f-c0a9-411d-a11c-1996a2863e32 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:54.940406 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 661/1302] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:18:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:18:54.945590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:54.945987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:54.946143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:54.963009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:18:54.963687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:18:55.028717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 642/1303] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:18:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 20:18:55.051739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d770f-c0a9-411d-a11c-1996a2863e32 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:55.145170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:55.151693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d770f-c0a9-411d-a11c-1996a2863e32 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:55.185190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:55.185979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:55.186260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:55.186532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:55.187170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:55.189159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 20:18:55.200926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 20:18:55.202118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application with Lock( Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self._enter() Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application return self.creator() Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application created_value = creator( Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: ERROR keystone.server.flask.application Jun 16 20:18:55.203157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 662/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Thu Jun 16 20:18:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 20:18:55.208255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:55.281999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:18:55.303807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b0e17-f723-40c4-a285-df35c7fa25b7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:55.335271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:55.336177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:55.336458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:55.336766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] PATH_INFO: `/v3/services` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:55.337469 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:18:55.337777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:55.339172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9de7a9-baf2-4138-8cb8-11f18660dcbf None admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:55.344593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 643/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Thu Jun 16 20:18:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:18:55.350722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:18:55.447300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754442f-f879-4d03-92b3-543b30d0213b None admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:18:55.485579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e1dda7-e023-473a-a3e2-b539c6e46e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:18:55.486357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1dda7-e023-473a-a3e2-b539c6e46e5e None admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:18:55.486627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1dda7-e023-473a-a3e2-b539c6e46e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:18:55.486902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e1dda7-e023-473a-a3e2-b539c6e46e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:18:55.487643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1dda7-e023-473a-a3e2-b539c6e46e5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:18:55.489029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e1dda7-e023-473a-a3e2-b539c6e46e5e None admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:18:55.780564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 663/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Thu Jun 16 20:18:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:19:05.463345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=30 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:19:05.775760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:04.653001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02d6e-5f17-4bd0-8b52-75bd108ed6f4 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:04.654579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02d6e-5f17-4bd0-8b52-75bd108ed6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:04.655909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d02d6e-5f17-4bd0-8b52-75bd108ed6f4 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:04.665279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc371-91df-4ec0-9fac-63f9c7752e45 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:04.665720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc371-91df-4ec0-9fac-63f9c7752e45 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:04.665833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc371-91df-4ec0-9fac-63f9c7752e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:04.672919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 644/1307] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:04 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:04.775580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-aacbc371-91df-4ec0-9fac-63f9c7752e45 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:04.777070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-aacbc371-91df-4ec0-9fac-63f9c7752e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:04.932506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 664/1308] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:27:04.972600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e1d0d-8333-44c6-8234-d86d20127dbd None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:04.974292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e1d0d-8333-44c6-8234-d86d20127dbd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:04.974292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e1d0d-8333-44c6-8234-d86d20127dbd None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:04.975929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 645/1309] 10.222.0.65 () {54 vars in 964 bytes} [Thu Jun 16 20:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:04.981990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f748-585a-4556-9161-f59a00d1565f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:04.982288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f748-585a-4556-9161-f59a00d1565f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:04.982574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023f748-585a-4556-9161-f59a00d1565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:05.089402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9023f748-585a-4556-9161-f59a00d1565f None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:05.090441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9023f748-585a-4556-9161-f59a00d1565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:05.112444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:05.170894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 665/1310] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Jun 16 20:27:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:05.181180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e1d0d-8333-44c6-8234-d86d20127dbd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:05.183142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0e2e1d0d-8333-44c6-8234-d86d20127dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:05.302210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e1d0d-8333-44c6-8234-d86d20127dbd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:05.384603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:05.385300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:05.385579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:05.385847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:05.387476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:05.445857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:05.503173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:05.504640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4115d-3a07-47a9-afad-04e80478bfa4 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:05.525371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 646/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:27:07.949899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccb9d-7903-49bf-a82f-e76190a50e72 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:07.950458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccb9d-7903-49bf-a82f-e76190a50e72 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:07.950458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eccb9d-7903-49bf-a82f-e76190a50e72 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:07.951964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 666/1312] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:07.957045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e53bd-9463-4ff1-94b6-39292d420871 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:07.957446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e53bd-9463-4ff1-94b6-39292d420871 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:07.957642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e53bd-9463-4ff1-94b6-39292d420871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:08.028802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9e6e53bd-9463-4ff1-94b6-39292d420871 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:08.029996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9e6e53bd-9463-4ff1-94b6-39292d420871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:08.152243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 647/1313] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:08.209170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4582ef3-56ff-4c7c-aa3b-e451990bf40a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:08.209381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4582ef3-56ff-4c7c-aa3b-e451990bf40a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:08.209663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4582ef3-56ff-4c7c-aa3b-e451990bf40a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:08.211624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 667/1314] 10.222.0.65 () {54 vars in 964 bytes} [Thu Jun 16 20:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:08.219069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e433-ac7f-4ef0-af2b-7abb9632a89d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:08.219358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e433-ac7f-4ef0-af2b-7abb9632a89d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:08.219921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754e433-ac7f-4ef0-af2b-7abb9632a89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:08.231094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:08.309359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3754e433-ac7f-4ef0-af2b-7abb9632a89d None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:08.310586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3754e433-ac7f-4ef0-af2b-7abb9632a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:08.409078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 648/1315] 10.222.0.65 () {58 vars in 1061 bytes} [Thu Jun 16 20:27:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:08.418442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4582ef3-56ff-4c7c-aa3b-e451990bf40a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:08.419957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b4582ef3-56ff-4c7c-aa3b-e451990bf40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:08.525569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4582ef3-56ff-4c7c-aa3b-e451990bf40a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:08.613361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:08.616976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:08.617547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:08.617832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:08.618104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:08.619756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:08.731690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:08.733155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d348ed13-8d01-46c2-a515-92ed583c6bcc service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:08.751246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 668/1316] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:11.577832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa158-c4dd-48f1-a25f-5ef101874d2f None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:11.578308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa158-c4dd-48f1-a25f-5ef101874d2f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:11.578402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa158-c4dd-48f1-a25f-5ef101874d2f None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:11.579761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 649/1317] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:11.585700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9808e-d428-4f41-8c53-bd5466ca0f3e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:11.586096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9808e-d428-4f41-8c53-bd5466ca0f3e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:11.586252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f9808e-d428-4f41-8c53-bd5466ca0f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:11.647186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c8f9808e-d428-4f41-8c53-bd5466ca0f3e None None] MFA Rules not processed for user `b3c17e280bf349a8875528eb95b4e25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:11.648941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c8f9808e-d428-4f41-8c53-bd5466ca0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:11.699816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:11.743352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 669/1318] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:11.782666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa158-c4dd-48f1-a25f-5ef101874d2f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:11.784202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d77aa158-c4dd-48f1-a25f-5ef101874d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:11.885334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa158-c4dd-48f1-a25f-5ef101874d2f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:11.888112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:11.957691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:11.958330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:11.958612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:11.958886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:11.961177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:12.066212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:12.067563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1c242-a3da-4c2c-8d09-c4e8b08c6668 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:12.086562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 650/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:15.190714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6d36-a3b4-4ea3-a19b-bd788e18d18b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:15.191284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6d36-a3b4-4ea3-a19b-bd788e18d18b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:15.191284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b6d36-a3b4-4ea3-a19b-bd788e18d18b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:15.192650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 670/1320] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:15.198324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7266f-185c-4cd4-a4f3-77ecc7203a26 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:15.198741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7266f-185c-4cd4-a4f3-77ecc7203a26 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:15.198879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7266f-185c-4cd4-a4f3-77ecc7203a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:15.236964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:15.262755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-32e7266f-185c-4cd4-a4f3-77ecc7203a26 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:15.263971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-32e7266f-185c-4cd4-a4f3-77ecc7203a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:15.357393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 651/1321] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:15.395952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6d36-a3b4-4ea3-a19b-bd788e18d18b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:15.398087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8d0b6d36-a3b4-4ea3-a19b-bd788e18d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:15.500921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b6d36-a3b4-4ea3-a19b-bd788e18d18b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:15.572416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:15.573083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:15.573369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:15.573646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:15.575284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:15.582445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:15.679863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:15.681309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49327926-f6c7-4830-9fda-d28f013d515c service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:15.700210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 671/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:18.924018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cce9a9-2b6b-4037-a8aa-fa1f0b14b350 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:18.924569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cce9a9-2b6b-4037-a8aa-fa1f0b14b350 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:18.924569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cce9a9-2b6b-4037-a8aa-fa1f0b14b350 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:18.925974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 652/1323] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:18.931166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cf17-e954-48c3-b849-1348fc1b5ae0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:18.931595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cf17-e954-48c3-b849-1348fc1b5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:18.931738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18cf17-e954-48c3-b849-1348fc1b5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:18.995621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7a18cf17-e954-48c3-b849-1348fc1b5ae0 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:18.996850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7a18cf17-e954-48c3-b849-1348fc1b5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:19.058163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:19.102044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 672/1324] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:19.139075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cce9a9-2b6b-4037-a8aa-fa1f0b14b350 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:19.140657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f5cce9a9-2b6b-4037-a8aa-fa1f0b14b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:19.248987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cce9a9-2b6b-4037-a8aa-fa1f0b14b350 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:19.262157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:19.323504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:19.324150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:19.324431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:19.324738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:19.326400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:19.432980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:19.434309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367c570-7453-413d-862d-c72ac6a95c38 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:19.452688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 653/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:21.641862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa60e-c1f5-48f6-ac41-83399d644484 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:21.642369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa60e-c1f5-48f6-ac41-83399d644484 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:21.642369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa60e-c1f5-48f6-ac41-83399d644484 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:21.643696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 673/1326] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:21.648950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55574-2fcb-4f6b-a142-ff54be683c0f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:21.649365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55574-2fcb-4f6b-a142-ff54be683c0f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:21.649509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f55574-2fcb-4f6b-a142-ff54be683c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:21.696026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:21.714241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-38f55574-2fcb-4f6b-a142-ff54be683c0f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:21.715687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-38f55574-2fcb-4f6b-a142-ff54be683c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:21.810603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 654/1327] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:21.846249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa60e-c1f5-48f6-ac41-83399d644484 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:21.847779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-087fa60e-c1f5-48f6-ac41-83399d644484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:21.951609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa60e-c1f5-48f6-ac41-83399d644484 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:22.028653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:22.029306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:22.029589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:22.029864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:22.031512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:22.048246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:22.144429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:22.145896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2645fd6-9df8-462f-8ea2-c00f64b2c935 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:22.171260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 674/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:24.348949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db16c-f925-42a0-9fae-d9ca08dfcb43 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:24.349490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db16c-f925-42a0-9fae-d9ca08dfcb43 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:24.349599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db16c-f925-42a0-9fae-d9ca08dfcb43 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:24.351089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 655/1329] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:24.356296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206b4f-b0e1-4f1c-81e3-b5607ed46d4e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:24.356747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206b4f-b0e1-4f1c-81e3-b5607ed46d4e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:24.356894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206b4f-b0e1-4f1c-81e3-b5607ed46d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:24.419470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5e206b4f-b0e1-4f1c-81e3-b5607ed46d4e None None] MFA Rules not processed for user `b3c17e280bf349a8875528eb95b4e25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:24.420680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5e206b4f-b0e1-4f1c-81e3-b5607ed46d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:24.486487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:24.519735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 675/1330] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:24.561290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db16c-f925-42a0-9fae-d9ca08dfcb43 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:24.562821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e37db16c-f925-42a0-9fae-d9ca08dfcb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:24.666763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db16c-f925-42a0-9fae-d9ca08dfcb43 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:24.686300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:24.755238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:24.755895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:24.756177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:24.756448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:24.758892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:24.874806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:24.876301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663f192-b329-4911-a0f9-fdab340ad3e7 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:24.893899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 656/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:27.448707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e736-ca13-4a23-9b93-0424fe2c144c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:27.449320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e736-ca13-4a23-9b93-0424fe2c144c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:27.449320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506e736-ca13-4a23-9b93-0424fe2c144c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:27.450610 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 676/1332] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:27.455695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710d90-8dd2-4983-ba65-f53372046615 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:27.456149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710d90-8dd2-4983-ba65-f53372046615 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:27.456251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b710d90-8dd2-4983-ba65-f53372046615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:27.517426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:27.520245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6b710d90-8dd2-4983-ba65-f53372046615 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:27.521478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b710d90-8dd2-4983-ba65-f53372046615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:27.617489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 657/1333] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:27.653095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e736-ca13-4a23-9b93-0424fe2c144c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:27.654628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9506e736-ca13-4a23-9b93-0424fe2c144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:27.755450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506e736-ca13-4a23-9b93-0424fe2c144c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:27.828325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:27.828990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:27.829272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:27.829544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:27.831140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:27.857017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:27.935557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:27.937090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66b753-cb35-4268-8e53-33c098e3ae2b service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:27.955720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 677/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:30.103126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea4c1-ef04-495b-a1f9-2bded4932d70 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:30.103703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea4c1-ef04-495b-a1f9-2bded4932d70 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:30.103703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eea4c1-ef04-495b-a1f9-2bded4932d70 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:30.105076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 658/1335] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:30.110306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf021-d7ff-4339-8475-0fe88ceca4ba None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:30.110712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf021-d7ff-4339-8475-0fe88ceca4ba None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:30.110874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcf021-d7ff-4339-8475-0fe88ceca4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:30.173964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f9dcf021-d7ff-4339-8475-0fe88ceca4ba None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:30.175176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f9dcf021-d7ff-4339-8475-0fe88ceca4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:30.247019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:30.268946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 678/1336] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:30.308445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eea4c1-ef04-495b-a1f9-2bded4932d70 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:30.310029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-97eea4c1-ef04-495b-a1f9-2bded4932d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:30.411064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eea4c1-ef04-495b-a1f9-2bded4932d70 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:30.438391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:30.483053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:30.483683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:30.483960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:30.484232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:30.485864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:30.601485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:30.602914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c107d-9c5a-424d-bc99-0a7a85758d51 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:30.621471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 659/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:33.276425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988359-9645-4683-8c29-10b165b06483 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:33.277035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988359-9645-4683-8c29-10b165b06483 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:33.277035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a988359-9645-4683-8c29-10b165b06483 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:33.278389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 679/1338] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:33.283512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5a20-36d3-4c56-951d-cee81efa2504 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:33.283938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5a20-36d3-4c56-951d-cee81efa2504 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:33.284058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df5a20-36d3-4c56-951d-cee81efa2504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:33.347248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-12df5a20-36d3-4c56-951d-cee81efa2504 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:33.348445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-12df5a20-36d3-4c56-951d-cee81efa2504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:33.359207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:33.445456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 660/1339] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:27:33.480683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988359-9645-4683-8c29-10b165b06483 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:33.482187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7a988359-9645-4683-8c29-10b165b06483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:33.583211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a988359-9645-4683-8c29-10b165b06483 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:33.653841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:33.654486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:33.654770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:33.655047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:33.656717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:33.692254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:33.763225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:33.764676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11719edc-9c07-4256-96fb-69a31746df4c service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:33.782145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 680/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:38.142046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb36f6-362b-4d77-b1bb-7dc7bfe3c5b1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:38.142637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb36f6-362b-4d77-b1bb-7dc7bfe3c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:38.142637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb36f6-362b-4d77-b1bb-7dc7bfe3c5b1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:38.145037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 661/1341] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:38.149904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884d59-2e6a-453b-948b-b414e0a5c893 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:38.150358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884d59-2e6a-453b-948b-b414e0a5c893 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:38.150535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884d59-2e6a-453b-948b-b414e0a5c893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:38.230665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-29884d59-2e6a-453b-948b-b414e0a5c893 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:38.231874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-29884d59-2e6a-453b-948b-b414e0a5c893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:38.322175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:38.336051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 681/1342] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:38.374063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb36f6-362b-4d77-b1bb-7dc7bfe3c5b1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:38.376339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-37eb36f6-362b-4d77-b1bb-7dc7bfe3c5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:38.476120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb36f6-362b-4d77-b1bb-7dc7bfe3c5b1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:38.479716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f9893-0731-4196-a0f1-9346245cefe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:38.480354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f9893-0731-4196-a0f1-9346245cefe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:38.480659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f9893-0731-4196-a0f1-9346245cefe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:38.480934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f9893-0731-4196-a0f1-9346245cefe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:38.490800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f9893-0731-4196-a0f1-9346245cefe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:38.492385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f9893-0731-4196-a0f1-9346245cefe6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:38.502255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 662/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:41.588372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597908a7-f256-4239-aaab-697ca13542f4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:41.588983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597908a7-f256-4239-aaab-697ca13542f4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:41.589077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597908a7-f256-4239-aaab-697ca13542f4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:41.590604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 682/1344] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:41.596309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c2be0-b0ee-4c18-b6bf-ff2907cdb434 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:41.596795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c2be0-b0ee-4c18-b6bf-ff2907cdb434 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:41.596912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c2be0-b0ee-4c18-b6bf-ff2907cdb434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:41.634431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-047c2be0-b0ee-4c18-b6bf-ff2907cdb434 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:41.635620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-047c2be0-b0ee-4c18-b6bf-ff2907cdb434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:41.662488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:41.712403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 663/1345] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:41.749865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597908a7-f256-4239-aaab-697ca13542f4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:41.760976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597908a7-f256-4239-aaab-697ca13542f4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:41.764536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87674bf6-202b-413f-918f-936dc2fa17a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:41.765206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674bf6-202b-413f-918f-936dc2fa17a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:41.765489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674bf6-202b-413f-918f-936dc2fa17a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:41.765765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87674bf6-202b-413f-918f-936dc2fa17a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:41.774880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87674bf6-202b-413f-918f-936dc2fa17a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:41.776290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87674bf6-202b-413f-918f-936dc2fa17a8 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:41.785602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 683/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:46.125872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719463f-2b4a-4ac5-84bf-7fb54d717095 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:46.126387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719463f-2b4a-4ac5-84bf-7fb54d717095 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:46.126387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719463f-2b4a-4ac5-84bf-7fb54d717095 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:46.127717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 664/1347] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:46.133723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52829-d023-4650-8c07-8b22f1ca07bd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:46.134140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52829-d023-4650-8c07-8b22f1ca07bd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:46.134396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52829-d023-4650-8c07-8b22f1ca07bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:46.152408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7ca52829-d023-4650-8c07-8b22f1ca07bd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:46.153637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7ca52829-d023-4650-8c07-8b22f1ca07bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:46.161487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 684/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:46.199686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719463f-2b4a-4ac5-84bf-7fb54d717095 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:27:46.210364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719463f-2b4a-4ac5-84bf-7fb54d717095 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:27:46.214148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae354f7c-45d3-4b7e-bf27-920dcf3a921b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:27:46.214783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354f7c-45d3-4b7e-bf27-920dcf3a921b service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:46.215064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354f7c-45d3-4b7e-bf27-920dcf3a921b service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:46.215340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae354f7c-45d3-4b7e-bf27-920dcf3a921b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:46.224594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354f7c-45d3-4b7e-bf27-920dcf3a921b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:27:46.226062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae354f7c-45d3-4b7e-bf27-920dcf3a921b service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:27:46.235635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 665/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:27:51.213318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae143-8faa-48cc-8cf8-efba98c13e11 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:51.213798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae143-8faa-48cc-8cf8-efba98c13e11 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:51.213877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ae143-8faa-48cc-8cf8-efba98c13e11 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:51.215612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 685/1350] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:51.222532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c255-4d0e-4327-bd14-225125713838 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:51.223345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c255-4d0e-4327-bd14-225125713838 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:51.223796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c255-4d0e-4327-bd14-225125713838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:51.343246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0222c255-4d0e-4327-bd14-225125713838 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:51.344534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0222c255-4d0e-4327-bd14-225125713838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:51.427296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 666/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:27:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:55.949601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad669d0-80b6-4a6b-9f7f-a87ca3bc80cf None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:55.950140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad669d0-80b6-4a6b-9f7f-a87ca3bc80cf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:55.950140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad669d0-80b6-4a6b-9f7f-a87ca3bc80cf None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:55.951694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 686/1352] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:55.957572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b9aeb-527b-4b96-ad91-1889125b6424 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:55.958492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b9aeb-527b-4b96-ad91-1889125b6424 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:55.959004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b9aeb-527b-4b96-ad91-1889125b6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:55.977970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e51b9aeb-527b-4b96-ad91-1889125b6424 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:55.979165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e51b9aeb-527b-4b96-ad91-1889125b6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:55.987965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 667/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:27:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:27:56.146841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=13 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:27:57.326766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459f4a-ebf0-4507-a31f-84e0c4a36864 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:57.327456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459f4a-ebf0-4507-a31f-84e0c4a36864 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:57.327456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c459f4a-ebf0-4507-a31f-84e0c4a36864 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:57.328697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 687/1354] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:27:57.333848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df4e0-ec8c-4b07-b63f-10f16934535c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:27:57.334319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df4e0-ec8c-4b07-b63f-10f16934535c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:27:57.334551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03df4e0-ec8c-4b07-b63f-10f16934535c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:27:57.353027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a03df4e0-ec8c-4b07-b63f-10f16934535c None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:27:57.354215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a03df4e0-ec8c-4b07-b63f-10f16934535c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:27:57.362846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 668/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:27:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:01.099516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92058268-84b8-491c-8cf0-59257f85ae53 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:01.100058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92058268-84b8-491c-8cf0-59257f85ae53 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:01.100264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92058268-84b8-491c-8cf0-59257f85ae53 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:01.101803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 688/1356] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:01.106891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf401b-60cb-4559-b721-efe002c314bd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:01.107298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf401b-60cb-4559-b721-efe002c314bd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:01.107440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf401b-60cb-4559-b721-efe002c314bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:01.125286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-19bf401b-60cb-4559-b721-efe002c314bd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:01.126388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-19bf401b-60cb-4559-b721-efe002c314bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:01.134939 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 669/1357] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:01.186645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dad5c1-bdab-4143-b1cd-0404ea682f23 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:01.187061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dad5c1-bdab-4143-b1cd-0404ea682f23 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:01.187551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dad5c1-bdab-4143-b1cd-0404ea682f23 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:01.189444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 689/1358] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jun 16 20:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:01.203188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0b03e-71c8-4962-9f38-fd345e3d79f2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:01.203670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0b03e-71c8-4962-9f38-fd345e3d79f2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:01.204095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0b03e-71c8-4962-9f38-fd345e3d79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:01.250206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:28:01.259235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b7c0b03e-71c8-4962-9f38-fd345e3d79f2 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:01.260897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b7c0b03e-71c8-4962-9f38-fd345e3d79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:01.353321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 670/1359] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jun 16 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:01.361094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dad5c1-bdab-4143-b1cd-0404ea682f23 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:01.377051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dad5c1-bdab-4143-b1cd-0404ea682f23 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:01.383159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedef7fe-031d-4fa8-a037-15bc9e230ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:01.383949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef7fe-031d-4fa8-a037-15bc9e230ae5 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:01.384340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef7fe-031d-4fa8-a037-15bc9e230ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:01.384783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedef7fe-031d-4fa8-a037-15bc9e230ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:01.393323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef7fe-031d-4fa8-a037-15bc9e230ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:01.395023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedef7fe-031d-4fa8-a037-15bc9e230ae5 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:01.404995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 690/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:03.744719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdf65-84f5-46f4-9024-1f12de1b86fc None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:03.745254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdf65-84f5-46f4-9024-1f12de1b86fc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:03.745254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbdf65-84f5-46f4-9024-1f12de1b86fc None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:03.746828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 671/1361] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:03.752388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce8b5-77ce-4b93-98ae-b62d752246e3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:03.753382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce8b5-77ce-4b93-98ae-b62d752246e3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:03.753869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ce8b5-77ce-4b93-98ae-b62d752246e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:03.774077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fa4ce8b5-77ce-4b93-98ae-b62d752246e3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:03.775317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fa4ce8b5-77ce-4b93-98ae-b62d752246e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:03.784082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 691/1362] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:03.832098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdf65-84f5-46f4-9024-1f12de1b86fc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:03.847291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbdf65-84f5-46f4-9024-1f12de1b86fc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:03.852909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc345322-64ff-4a31-9282-4597473b2c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:03.853568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc345322-64ff-4a31-9282-4597473b2c62 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:03.853853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc345322-64ff-4a31-9282-4597473b2c62 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:03.854133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc345322-64ff-4a31-9282-4597473b2c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:03.867199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc345322-64ff-4a31-9282-4597473b2c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:03.868831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc345322-64ff-4a31-9282-4597473b2c62 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:03.880828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 672/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:06.521405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974cc70-4c9a-4e0b-80f4-4d2f99a85f4a None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:06.521841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974cc70-4c9a-4e0b-80f4-4d2f99a85f4a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:06.521955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974cc70-4c9a-4e0b-80f4-4d2f99a85f4a None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:06.524230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 692/1364] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:06.529552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b6a4-12b9-419a-8f80-7eaedf60ae8e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:06.529950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b6a4-12b9-419a-8f80-7eaedf60ae8e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:06.529950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3b6a4-12b9-419a-8f80-7eaedf60ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:06.549870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c7d3b6a4-12b9-419a-8f80-7eaedf60ae8e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:06.551167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c7d3b6a4-12b9-419a-8f80-7eaedf60ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:06.559886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 673/1365] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:06.609563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19017-7fe8-45b0-a708-f1e2c0c19153 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:06.609563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19017-7fe8-45b0-a708-f1e2c0c19153 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:06.609563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d19017-7fe8-45b0-a708-f1e2c0c19153 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:06.609563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 693/1366] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jun 16 20:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:06.612478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06853b9-de86-4e57-8e06-a9d663bfe4bb None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:06.612965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06853b9-de86-4e57-8e06-a9d663bfe4bb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:06.613787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06853b9-de86-4e57-8e06-a9d663bfe4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:06.642776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b06853b9-de86-4e57-8e06-a9d663bfe4bb None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:06.644269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b06853b9-de86-4e57-8e06-a9d663bfe4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:06.655001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 674/1367] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jun 16 20:28:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:06.662760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19017-7fe8-45b0-a708-f1e2c0c19153 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:06.677104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d19017-7fe8-45b0-a708-f1e2c0c19153 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:06.683124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2283c2-3348-4010-9cdf-cbc30d88fb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:06.683707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2283c2-3348-4010-9cdf-cbc30d88fb90 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:06.683993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2283c2-3348-4010-9cdf-cbc30d88fb90 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:06.684269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2283c2-3348-4010-9cdf-cbc30d88fb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:06.692891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2283c2-3348-4010-9cdf-cbc30d88fb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:06.695068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2283c2-3348-4010-9cdf-cbc30d88fb90 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:06.704385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 694/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:09.029005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3474603-49cc-4579-8ad3-2defe9875a27 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.029543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3474603-49cc-4579-8ad3-2defe9875a27 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.029543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3474603-49cc-4579-8ad3-2defe9875a27 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.030930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 675/1369] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:09.036288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c717-81d5-4440-9471-f9e562ca68ce None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.036761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c717-81d5-4440-9471-f9e562ca68ce None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.036877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c717-81d5-4440-9471-f9e562ca68ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.055508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-49f9c717-81d5-4440-9471-f9e562ca68ce None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:09.056730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-49f9c717-81d5-4440-9471-f9e562ca68ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:09.064798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 695/1370] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:09.110579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3474603-49cc-4579-8ad3-2defe9875a27 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:09.126120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3474603-49cc-4579-8ad3-2defe9875a27 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:09.131695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739556-c9de-4523-8abe-85de16709881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:09.132363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739556-c9de-4523-8abe-85de16709881 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.132675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739556-c9de-4523-8abe-85de16709881 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.132953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739556-c9de-4523-8abe-85de16709881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.141858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739556-c9de-4523-8abe-85de16709881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:09.143438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739556-c9de-4523-8abe-85de16709881 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:09.153468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 676/1371] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:09.324051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682327-afd4-4b9a-920b-2caca338e237 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.324268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682327-afd4-4b9a-920b-2caca338e237 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.324550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90682327-afd4-4b9a-920b-2caca338e237 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.326118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 696/1372] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:09.331406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154148dc-2941-47b5-aeb8-91c6030366fd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.331697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154148dc-2941-47b5-aeb8-91c6030366fd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.332008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154148dc-2941-47b5-aeb8-91c6030366fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.351464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-154148dc-2941-47b5-aeb8-91c6030366fd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:09.353687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-154148dc-2941-47b5-aeb8-91c6030366fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:09.361062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 677/1373] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:09.668501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65554634-f07e-4302-9e43-f39c8b7d3ea2 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.668501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65554634-f07e-4302-9e43-f39c8b7d3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.668501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65554634-f07e-4302-9e43-f39c8b7d3ea2 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.669939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 697/1374] 10.222.0.65 () {54 vars in 963 bytes} [Thu Jun 16 20:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:09.673716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2148d2-968d-44d9-9cd8-baf8dd9935ca None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.674000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2148d2-968d-44d9-9cd8-baf8dd9935ca None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.674273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2148d2-968d-44d9-9cd8-baf8dd9935ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.724480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bf2148d2-968d-44d9-9cd8-baf8dd9935ca None None] MFA Rules not processed for user `21161c14bb024771be73ce9248ef515c`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:09.726403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bf2148d2-968d-44d9-9cd8-baf8dd9935ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:09.789386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 678/1375] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Jun 16 20:28:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:09.797712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65554634-f07e-4302-9e43-f39c8b7d3ea2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:09.808427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65554634-f07e-4302-9e43-f39c8b7d3ea2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:09.812121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffaafb-734a-4160-935f-ae9527d51043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:09.812799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffaafb-734a-4160-935f-ae9527d51043 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:09.813084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffaafb-734a-4160-935f-ae9527d51043 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:09.813360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffaafb-734a-4160-935f-ae9527d51043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:09.823664 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffaafb-734a-4160-935f-ae9527d51043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:09.825128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffaafb-734a-4160-935f-ae9527d51043 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:09.836081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 698/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:11.507355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4192-d5e7-4f45-a6c4-1da092893fb8 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:11.507889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4192-d5e7-4f45-a6c4-1da092893fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:11.507889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c4192-d5e7-4f45-a6c4-1da092893fb8 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:11.509440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 679/1377] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:11.515348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c94af-36b2-4cfe-938d-1720b6e35d40 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:11.515922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c94af-36b2-4cfe-938d-1720b6e35d40 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:11.515922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c94af-36b2-4cfe-938d-1720b6e35d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:11.534808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e67c94af-36b2-4cfe-938d-1720b6e35d40 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:11.536046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e67c94af-36b2-4cfe-938d-1720b6e35d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:11.544284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 699/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:11.590460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4192-d5e7-4f45-a6c4-1da092893fb8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:11.605202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c4192-d5e7-4f45-a6c4-1da092893fb8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:11.610679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86dd27-2867-4d3a-bf9c-e8df4d0c8eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:11.611347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86dd27-2867-4d3a-bf9c-e8df4d0c8eda service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:11.611711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86dd27-2867-4d3a-bf9c-e8df4d0c8eda service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:11.611989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86dd27-2867-4d3a-bf9c-e8df4d0c8eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:11.621258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86dd27-2867-4d3a-bf9c-e8df4d0c8eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:11.623034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86dd27-2867-4d3a-bf9c-e8df4d0c8eda service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:11.627017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:28:11.634775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 680/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:13.935254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22327697-48cf-482b-8588-8e913d96faf6 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:13.935801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22327697-48cf-482b-8588-8e913d96faf6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:13.936056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22327697-48cf-482b-8588-8e913d96faf6 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:13.937679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 700/1380] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:13.943149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5efe88-58b5-4416-ad6e-cf27d4e80fde None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:13.943552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5efe88-58b5-4416-ad6e-cf27d4e80fde None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:13.943696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5efe88-58b5-4416-ad6e-cf27d4e80fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:13.962076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fc5efe88-58b5-4416-ad6e-cf27d4e80fde None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:13.963256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fc5efe88-58b5-4416-ad6e-cf27d4e80fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:13.971365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 681/1381] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:14.016685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22327697-48cf-482b-8588-8e913d96faf6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:14.032060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22327697-48cf-482b-8588-8e913d96faf6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:14.037632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75456e57-53f3-4c77-901e-cb4a4567e1e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:14.038911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456e57-53f3-4c77-901e-cb4a4567e1e3 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:14.039285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456e57-53f3-4c77-901e-cb4a4567e1e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:14.039650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75456e57-53f3-4c77-901e-cb4a4567e1e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:14.048183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75456e57-53f3-4c77-901e-cb4a4567e1e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:14.049894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75456e57-53f3-4c77-901e-cb4a4567e1e3 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:14.059865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 701/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:16.356413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9519885-4ad1-4c21-9dbb-103e081cc22b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:16.357082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9519885-4ad1-4c21-9dbb-103e081cc22b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:16.357082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9519885-4ad1-4c21-9dbb-103e081cc22b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:16.358598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 682/1383] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:16.364774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200acf38-f07f-426c-8a50-d1da0d4876db None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:16.365352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200acf38-f07f-426c-8a50-d1da0d4876db None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:16.365352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200acf38-f07f-426c-8a50-d1da0d4876db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:16.393566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-200acf38-f07f-426c-8a50-d1da0d4876db None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:16.394805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-200acf38-f07f-426c-8a50-d1da0d4876db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:16.403040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 702/1384] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:16.445941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9519885-4ad1-4c21-9dbb-103e081cc22b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:16.463822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9519885-4ad1-4c21-9dbb-103e081cc22b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:16.469492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734770e1-37f3-48d2-96b8-6bd7edd2a45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:16.475387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734770e1-37f3-48d2-96b8-6bd7edd2a45c service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:16.475387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734770e1-37f3-48d2-96b8-6bd7edd2a45c service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:16.475387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734770e1-37f3-48d2-96b8-6bd7edd2a45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:16.479931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734770e1-37f3-48d2-96b8-6bd7edd2a45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:16.482267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734770e1-37f3-48d2-96b8-6bd7edd2a45c service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:16.493474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 683/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:18.895967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2009d6-8e02-4124-bfa7-0fb040bb88bf None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:18.896485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2009d6-8e02-4124-bfa7-0fb040bb88bf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:18.896568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2009d6-8e02-4124-bfa7-0fb040bb88bf None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:18.898762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 703/1386] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:18.904474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da0885-1e83-4906-824a-bdd0e39e744d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:18.905133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da0885-1e83-4906-824a-bdd0e39e744d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:18.905133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da0885-1e83-4906-824a-bdd0e39e744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:18.924394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f7da0885-1e83-4906-824a-bdd0e39e744d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:18.925648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f7da0885-1e83-4906-824a-bdd0e39e744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:18.933456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 684/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:18.978503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2009d6-8e02-4124-bfa7-0fb040bb88bf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:18.994947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2009d6-8e02-4124-bfa7-0fb040bb88bf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:19.000768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f7ca0-f111-49c0-922a-e772a7940e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:19.001403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f7ca0-f111-49c0-922a-e772a7940e61 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:19.001683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f7ca0-f111-49c0-922a-e772a7940e61 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:19.001959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f7ca0-f111-49c0-922a-e772a7940e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:19.010838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f7ca0-f111-49c0-922a-e772a7940e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:19.012396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f7ca0-f111-49c0-922a-e772a7940e61 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:19.021708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 704/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:21.415305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae69eb7-42c5-4938-bfed-66fd1bd7cb8e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:21.415896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae69eb7-42c5-4938-bfed-66fd1bd7cb8e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:21.415896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae69eb7-42c5-4938-bfed-66fd1bd7cb8e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:21.417265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 685/1389] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:21.423156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf39e-3dde-466f-ac4a-54de6374df3a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:21.424212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf39e-3dde-466f-ac4a-54de6374df3a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:21.424387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf39e-3dde-466f-ac4a-54de6374df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:21.444321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-45fbf39e-3dde-466f-ac4a-54de6374df3a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:21.445854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-45fbf39e-3dde-466f-ac4a-54de6374df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:21.454967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 705/1390] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:28:21.501062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae69eb7-42c5-4938-bfed-66fd1bd7cb8e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:21.515709 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae69eb7-42c5-4938-bfed-66fd1bd7cb8e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:21.521330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1e1c1-6bf1-437b-b33c-3b1ebaeb74fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:21.522500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e1c1-6bf1-437b-b33c-3b1ebaeb74fa service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:21.522800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e1c1-6bf1-437b-b33c-3b1ebaeb74fa service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:21.523126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1e1c1-6bf1-437b-b33c-3b1ebaeb74fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:21.531672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1e1c1-6bf1-437b-b33c-3b1ebaeb74fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:21.533272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1e1c1-6bf1-437b-b33c-3b1ebaeb74fa service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:21.543694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 686/1391] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:28:23.878871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4837-9288-41d1-bd29-e9dbc70df15e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:23.879389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4837-9288-41d1-bd29-e9dbc70df15e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:23.879389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cee4837-9288-41d1-bd29-e9dbc70df15e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:23.880746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 706/1392] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:23.885871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ae52c-dd9e-4faf-9a63-9d71ccdc3ed0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:23.886300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ae52c-dd9e-4faf-9a63-9d71ccdc3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:23.886434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ae52c-dd9e-4faf-9a63-9d71ccdc3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:23.904778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-328ae52c-dd9e-4faf-9a63-9d71ccdc3ed0 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:23.905981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-328ae52c-dd9e-4faf-9a63-9d71ccdc3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:23.914279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 687/1393] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:23.957312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4837-9288-41d1-bd29-e9dbc70df15e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:23.972036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cee4837-9288-41d1-bd29-e9dbc70df15e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:23.978098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3662b5-e17f-4bed-9398-5c2234cbd019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:23.978739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3662b5-e17f-4bed-9398-5c2234cbd019 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:23.979025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3662b5-e17f-4bed-9398-5c2234cbd019 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:23.979305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3662b5-e17f-4bed-9398-5c2234cbd019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:23.987687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3662b5-e17f-4bed-9398-5c2234cbd019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:23.989304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3662b5-e17f-4bed-9398-5c2234cbd019 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:23.998714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 707/1394] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:25.330715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e2dc-97f4-4b3f-9d32-aaf09b78d4ee None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:25.331284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e2dc-97f4-4b3f-9d32-aaf09b78d4ee None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:25.331284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c63e2dc-97f4-4b3f-9d32-aaf09b78d4ee None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:25.332671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 688/1395] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:25.337994 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dc94b-0dbe-4e39-949b-27edff137ee2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:25.338459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dc94b-0dbe-4e39-949b-27edff137ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:25.338560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128dc94b-0dbe-4e39-949b-27edff137ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:25.356444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-128dc94b-0dbe-4e39-949b-27edff137ee2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:25.357656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-128dc94b-0dbe-4e39-949b-27edff137ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:25.365367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 708/1396] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:25.420937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ab26-fc27-44d2-bf45-36892dbc39b7 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:25.421230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ab26-fc27-44d2-bf45-36892dbc39b7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:25.421507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ab26-fc27-44d2-bf45-36892dbc39b7 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:25.422902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 689/1397] 10.222.0.65 () {54 vars in 962 bytes} [Thu Jun 16 20:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:25.427939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e466f8-c66b-4397-b84e-9ebdf689536d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:25.428869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e466f8-c66b-4397-b84e-9ebdf689536d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:25.429148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e466f8-c66b-4397-b84e-9ebdf689536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:25.476812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-02e466f8-c66b-4397-b84e-9ebdf689536d None None] MFA Rules not processed for user `37174d8d343d4989a8c41b4d43246c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:25.477999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-02e466f8-c66b-4397-b84e-9ebdf689536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:25.537294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 709/1398] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Jun 16 20:28:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:25.545691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ab26-fc27-44d2-bf45-36892dbc39b7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:25.556910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18ab26-fc27-44d2-bf45-36892dbc39b7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:25.560458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965be130-288f-4f48-adcb-df44208cb365 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:25.561194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965be130-288f-4f48-adcb-df44208cb365 service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:25.561543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965be130-288f-4f48-adcb-df44208cb365 service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:25.561889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965be130-288f-4f48-adcb-df44208cb365 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:25.572032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965be130-288f-4f48-adcb-df44208cb365 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:25.573487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965be130-288f-4f48-adcb-df44208cb365 service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:25.582837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 690/1399] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:26.479285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b346f91-d6a6-45b1-94bc-740235146f27 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.479866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b346f91-d6a6-45b1-94bc-740235146f27 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.479866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b346f91-d6a6-45b1-94bc-740235146f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.485354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=93 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:28:26.531782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b346f91-d6a6-45b1-94bc-740235146f27 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:26.533624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b346f91-d6a6-45b1-94bc-740235146f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:26.597485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de008-fb27-48f4-9d04-ab01429b76f0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.598041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de008-fb27-48f4-9d04-ab01429b76f0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.598041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754de008-fb27-48f4-9d04-ab01429b76f0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.599300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 691/1400] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:26.601748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 710/1401] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:28:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:26.604009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766337c-558a-4aee-8dc9-e153d2dfbb38 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.604296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766337c-558a-4aee-8dc9-e153d2dfbb38 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.604604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3766337c-558a-4aee-8dc9-e153d2dfbb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.623323 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3766337c-558a-4aee-8dc9-e153d2dfbb38 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:26.624508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3766337c-558a-4aee-8dc9-e153d2dfbb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:26.632907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 692/1402] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:26.646728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159747dd-b061-4da1-b042-a547be104654 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.647585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159747dd-b061-4da1-b042-a547be104654 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.647863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159747dd-b061-4da1-b042-a547be104654 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.649275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 711/1403] 10.222.0.65 () {54 vars in 942 bytes} [Thu Jun 16 20:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:26.655657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fcc5d-9fa7-489b-923e-92f694b9c07f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.655950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fcc5d-9fa7-489b-923e-92f694b9c07f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.656262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6fcc5d-9fa7-489b-923e-92f694b9c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.675767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159747dd-b061-4da1-b042-a547be104654 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:26.689999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159747dd-b061-4da1-b042-a547be104654 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:26.696231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:26.696890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.697166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.697435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.705398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:26.706663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-be6fcc5d-9fa7-489b-923e-92f694b9c07f None None] MFA Rules not processed for user `a73a2387e0164fc7936ae83eb81b818f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:26.706959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:26.707853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-be6fcc5d-9fa7-489b-923e-92f694b9c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:26.716645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 712/1404] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:26.777692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 693/1405] 10.222.0.65 () {58 vars in 1039 bytes} [Thu Jun 16 20:28:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:26.786933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:26.797781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f56f4-6586-408b-a5fa-dbfe55474493 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:26.802852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a28a2-34df-42f9-a2fc-cccb25bc9bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:26.804184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a28a2-34df-42f9-a2fc-cccb25bc9bb1 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:26.804578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a28a2-34df-42f9-a2fc-cccb25bc9bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:26.804997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a28a2-34df-42f9-a2fc-cccb25bc9bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:26.816024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a28a2-34df-42f9-a2fc-cccb25bc9bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:26.818029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a28a2-34df-42f9-a2fc-cccb25bc9bb1 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:26.828930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 713/1406] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:28:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:28:29.159668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77073-0a3e-4e53-b396-add9005c4233 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:29.160247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77073-0a3e-4e53-b396-add9005c4233 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:29.160247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e77073-0a3e-4e53-b396-add9005c4233 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:29.166130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 694/1407] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:29.167818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c007-2b56-470b-8189-b4a52a74ba23 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:29.168580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c007-2b56-470b-8189-b4a52a74ba23 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:29.168887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c007-2b56-470b-8189-b4a52a74ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:29.202982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c243c007-2b56-470b-8189-b4a52a74ba23 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:29.204211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c243c007-2b56-470b-8189-b4a52a74ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:29.212767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 714/1408] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:29.258354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e77073-0a3e-4e53-b396-add9005c4233 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:29.276681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e77073-0a3e-4e53-b396-add9005c4233 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:29.283082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b0bda-1936-422e-b20a-0fdefd1e8922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:29.283571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0bda-1936-422e-b20a-0fdefd1e8922 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:29.283875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0bda-1936-422e-b20a-0fdefd1e8922 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:29.284278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b0bda-1936-422e-b20a-0fdefd1e8922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:29.297396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b0bda-1936-422e-b20a-0fdefd1e8922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:29.297396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b0bda-1936-422e-b20a-0fdefd1e8922 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:29.308173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 695/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:39.196390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=54 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:28:39.303289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=81 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:28:51.037258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef5921-d6bd-4d2d-abad-437c79808a3c None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:51.037862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef5921-d6bd-4d2d-abad-437c79808a3c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:51.037862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef5921-d6bd-4d2d-abad-437c79808a3c None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:51.039211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 715/1410] 10.222.0.65 () {54 vars in 918 bytes} [Thu Jun 16 20:28:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:51.044200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1722d4f-99dc-48d9-94a9-1e332fcd8917 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:51.044688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1722d4f-99dc-48d9-94a9-1e332fcd8917 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:51.044879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1722d4f-99dc-48d9-94a9-1e332fcd8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:51.063273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f1722d4f-99dc-48d9-94a9-1e332fcd8917 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:51.064494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f1722d4f-99dc-48d9-94a9-1e332fcd8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:51.073424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 696/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jun 16 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:51.087561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41471f34-6e2d-4fc6-bc3d-8a2afbce638b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:51.087853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41471f34-6e2d-4fc6-bc3d-8a2afbce638b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:51.088128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41471f34-6e2d-4fc6-bc3d-8a2afbce638b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:51.089594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 716/1412] 10.222.0.65 () {54 vars in 918 bytes} [Thu Jun 16 20:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:51.094193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3e45a-806b-4dc4-ab91-97c8e8d31a3d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:51.094513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3e45a-806b-4dc4-ab91-97c8e8d31a3d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:51.094792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3e45a-806b-4dc4-ab91-97c8e8d31a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:51.113833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-10a3e45a-806b-4dc4-ab91-97c8e8d31a3d None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:51.115081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-10a3e45a-806b-4dc4-ab91-97c8e8d31a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:51.124797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 697/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Thu Jun 16 20:28:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:53.703014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036750-a28d-4ab0-b2d3-7481cdcbc9c0 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:53.703573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036750-a28d-4ab0-b2d3-7481cdcbc9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:53.703573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b036750-a28d-4ab0-b2d3-7481cdcbc9c0 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:53.704950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 717/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:53.710068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7282-7448-44be-b7f2-3543b770bf33 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:53.710480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7282-7448-44be-b7f2-3543b770bf33 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:53.710617 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7282-7448-44be-b7f2-3543b770bf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:53.728026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6e5e7282-7448-44be-b7f2-3543b770bf33 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:53.729232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6e5e7282-7448-44be-b7f2-3543b770bf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:53.736867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 698/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:53.781128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036750-a28d-4ab0-b2d3-7481cdcbc9c0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:53.795067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b036750-a28d-4ab0-b2d3-7481cdcbc9c0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:53.800310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb9a55-556a-48cb-91a0-8220e53d83c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:53.800971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb9a55-556a-48cb-91a0-8220e53d83c2 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:53.801255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb9a55-556a-48cb-91a0-8220e53d83c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:53.801532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb9a55-556a-48cb-91a0-8220e53d83c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:53.810002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb9a55-556a-48cb-91a0-8220e53d83c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:53.811570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb9a55-556a-48cb-91a0-8220e53d83c2 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:53.821808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 718/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:54.762139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81e99-4bda-467e-83ad-6c375cd2207c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:54.762684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81e99-4bda-467e-83ad-6c375cd2207c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:54.762684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae81e99-4bda-467e-83ad-6c375cd2207c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:54.764038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 699/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:54.768874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089c7e-e4f0-4b47-8ba9-2ece699a4c61 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:54.769312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089c7e-e4f0-4b47-8ba9-2ece699a4c61 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:54.769432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089c7e-e4f0-4b47-8ba9-2ece699a4c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:54.787914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-57089c7e-e4f0-4b47-8ba9-2ece699a4c61 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:54.789130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-57089c7e-e4f0-4b47-8ba9-2ece699a4c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:54.796894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 719/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:54.948052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81e99-4bda-467e-83ad-6c375cd2207c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:54.962639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae81e99-4bda-467e-83ad-6c375cd2207c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:54.967910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a97501-cf60-45ac-9f4c-29515cc90ff6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:54.968537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a97501-cf60-45ac-9f4c-29515cc90ff6 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:54.968844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a97501-cf60-45ac-9f4c-29515cc90ff6 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:54.969115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a97501-cf60-45ac-9f4c-29515cc90ff6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:54.977077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a97501-cf60-45ac-9f4c-29515cc90ff6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:54.978665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a97501-cf60-45ac-9f4c-29515cc90ff6 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:54.987792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 700/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:55.916451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513c547-b634-4b0c-9597-b8dc51eeae06 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:55.917005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513c547-b634-4b0c-9597-b8dc51eeae06 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:55.917119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513c547-b634-4b0c-9597-b8dc51eeae06 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:55.918432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 720/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:55.923204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac743a-18c3-4575-9e89-cff64634d292 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:55.923661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac743a-18c3-4575-9e89-cff64634d292 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:55.923773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac743a-18c3-4575-9e89-cff64634d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:55.942214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-40ac743a-18c3-4575-9e89-cff64634d292 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:55.943390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-40ac743a-18c3-4575-9e89-cff64634d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:55.951084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 701/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:56.101722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513c547-b634-4b0c-9597-b8dc51eeae06 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:56.115619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513c547-b634-4b0c-9597-b8dc51eeae06 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:56.120929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83bc029-ef2d-4dfb-8d83-ce8ab3060632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:56.121554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bc029-ef2d-4dfb-8d83-ce8ab3060632 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:56.121836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bc029-ef2d-4dfb-8d83-ce8ab3060632 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:56.122109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83bc029-ef2d-4dfb-8d83-ce8ab3060632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:56.130038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bc029-ef2d-4dfb-8d83-ce8ab3060632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:56.131596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83bc029-ef2d-4dfb-8d83-ce8ab3060632 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:56.140789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 721/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:57.037649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938e5e-33ec-4eff-a0ce-372fa6d4446c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:57.038183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938e5e-33ec-4eff-a0ce-372fa6d4446c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:57.038183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938e5e-33ec-4eff-a0ce-372fa6d4446c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:57.039544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 702/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:57.044492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2089c3-4c8b-4b2e-b87f-c13bae7582c3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:57.044944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2089c3-4c8b-4b2e-b87f-c13bae7582c3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:57.045085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2089c3-4c8b-4b2e-b87f-c13bae7582c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:57.063084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-fc2089c3-4c8b-4b2e-b87f-c13bae7582c3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:57.064276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fc2089c3-4c8b-4b2e-b87f-c13bae7582c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:57.072264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 722/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:57.221234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938e5e-33ec-4eff-a0ce-372fa6d4446c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:57.235851 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938e5e-33ec-4eff-a0ce-372fa6d4446c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:57.241662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270f2ed-84da-4ad8-8680-d0afe528e732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:57.242279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270f2ed-84da-4ad8-8680-d0afe528e732 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:57.242558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270f2ed-84da-4ad8-8680-d0afe528e732 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:57.242831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270f2ed-84da-4ad8-8680-d0afe528e732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:57.250696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270f2ed-84da-4ad8-8680-d0afe528e732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:57.252306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270f2ed-84da-4ad8-8680-d0afe528e732 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:57.261811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 703/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:58.160263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5844f-ab69-47e0-9228-ee56de797868 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:58.160827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5844f-ab69-47e0-9228-ee56de797868 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:58.160948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5844f-ab69-47e0-9228-ee56de797868 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:58.162299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 723/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:58.167263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0819b0c-b54b-42f9-8a96-42bce9739b1f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:58.167709 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0819b0c-b54b-42f9-8a96-42bce9739b1f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:58.167812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0819b0c-b54b-42f9-8a96-42bce9739b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:58.185740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b0819b0c-b54b-42f9-8a96-42bce9739b1f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:58.186911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b0819b0c-b54b-42f9-8a96-42bce9739b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:58.195327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 704/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:58.344838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5844f-ab69-47e0-9228-ee56de797868 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:58.358919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5844f-ab69-47e0-9228-ee56de797868 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:58.364895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809923aa-aaf9-40d1-b480-03c3f570974f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:58.365528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809923aa-aaf9-40d1-b480-03c3f570974f service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:58.365810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809923aa-aaf9-40d1-b480-03c3f570974f service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:58.366090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809923aa-aaf9-40d1-b480-03c3f570974f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:58.374094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809923aa-aaf9-40d1-b480-03c3f570974f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:58.375652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809923aa-aaf9-40d1-b480-03c3f570974f service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:58.385596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 724/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:28:59.315776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c5a7-e7c4-4cb7-a5d2-733e427133b1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:59.316370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c5a7-e7c4-4cb7-a5d2-733e427133b1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:59.316370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c5a7-e7c4-4cb7-a5d2-733e427133b1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:59.318484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 705/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:28:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:28:59.323425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814188-41d1-4c5b-97a1-4f569c667f41 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:59.323835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814188-41d1-4c5b-97a1-4f569c667f41 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:59.323982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b814188-41d1-4c5b-97a1-4f569c667f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:59.342005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b814188-41d1-4c5b-97a1-4f569c667f41 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:28:59.343191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b814188-41d1-4c5b-97a1-4f569c667f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:28:59.350876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 725/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:28:59.501087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c5a7-e7c4-4cb7-a5d2-733e427133b1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:28:59.515686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c5a7-e7c4-4cb7-a5d2-733e427133b1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:28:59.521683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82113e0b-fc29-444c-937d-a8e549ece254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:28:59.522303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82113e0b-fc29-444c-937d-a8e549ece254 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:28:59.522582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82113e0b-fc29-444c-937d-a8e549ece254 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:28:59.522853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82113e0b-fc29-444c-937d-a8e549ece254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:28:59.530776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82113e0b-fc29-444c-937d-a8e549ece254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:28:59.532324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82113e0b-fc29-444c-937d-a8e549ece254 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:28:59.541445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 706/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:00.434477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636372cc-dd33-47f4-8d34-6947d345881e None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:00.435030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636372cc-dd33-47f4-8d34-6947d345881e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:00.435030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636372cc-dd33-47f4-8d34-6947d345881e None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:00.436388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 726/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:00.441159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476121-b1f4-40f3-b607-151fc44c620e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:00.441590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476121-b1f4-40f3-b607-151fc44c620e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:00.441979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89476121-b1f4-40f3-b607-151fc44c620e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:00.460059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-89476121-b1f4-40f3-b607-151fc44c620e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:00.461281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-89476121-b1f4-40f3-b607-151fc44c620e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:00.469058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 707/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:00.618415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636372cc-dd33-47f4-8d34-6947d345881e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:00.632388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636372cc-dd33-47f4-8d34-6947d345881e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:00.637648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32eac9d-424e-43f8-a68e-00270e95a03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:00.638263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eac9d-424e-43f8-a68e-00270e95a03a service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:00.638544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eac9d-424e-43f8-a68e-00270e95a03a service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:00.638815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32eac9d-424e-43f8-a68e-00270e95a03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:00.647223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eac9d-424e-43f8-a68e-00270e95a03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:00.648842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32eac9d-424e-43f8-a68e-00270e95a03a service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:00.658028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 727/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:01.567132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb67b-718c-4486-a17c-a73c84b6a818 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:01.570322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb67b-718c-4486-a17c-a73c84b6a818 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:01.570322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb67b-718c-4486-a17c-a73c84b6a818 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:01.570322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 708/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:01.574158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce316b-5182-4eff-9495-d83e78fe72e3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:01.574571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce316b-5182-4eff-9495-d83e78fe72e3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:01.574718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce316b-5182-4eff-9495-d83e78fe72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:01.594378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b5ce316b-5182-4eff-9495-d83e78fe72e3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:01.594553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b5ce316b-5182-4eff-9495-d83e78fe72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:01.602837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 728/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:01.754836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cb67b-718c-4486-a17c-a73c84b6a818 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:01.769710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cb67b-718c-4486-a17c-a73c84b6a818 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:01.775589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb947a-6ef0-4ecc-8fe6-bfe6e579e793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:01.776122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb947a-6ef0-4ecc-8fe6-bfe6e579e793 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:01.776406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb947a-6ef0-4ecc-8fe6-bfe6e579e793 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:01.776715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb947a-6ef0-4ecc-8fe6-bfe6e579e793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:01.785675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb947a-6ef0-4ecc-8fe6-bfe6e579e793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:01.787752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb947a-6ef0-4ecc-8fe6-bfe6e579e793 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:01.797122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 709/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:02.672439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6860699-9c4a-4c5b-ac58-b340a5075a25 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:02.672880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6860699-9c4a-4c5b-ac58-b340a5075a25 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:02.673035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6860699-9c4a-4c5b-ac58-b340a5075a25 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:02.674422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 729/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:02.679470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339883-2b25-4260-9512-8c105df1aa1a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:02.679900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339883-2b25-4260-9512-8c105df1aa1a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:02.680018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339883-2b25-4260-9512-8c105df1aa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:02.697710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c0339883-2b25-4260-9512-8c105df1aa1a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:02.698889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0339883-2b25-4260-9512-8c105df1aa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:02.706461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 710/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:02.856951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6860699-9c4a-4c5b-ac58-b340a5075a25 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:02.871308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6860699-9c4a-4c5b-ac58-b340a5075a25 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:02.876869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1412a-6fa9-4013-b978-bc3ec38444e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:02.877493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1412a-6fa9-4013-b978-bc3ec38444e1 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:02.877771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1412a-6fa9-4013-b978-bc3ec38444e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:02.878044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1412a-6fa9-4013-b978-bc3ec38444e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:02.886278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1412a-6fa9-4013-b978-bc3ec38444e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:02.887977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d1412a-6fa9-4013-b978-bc3ec38444e1 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:02.898128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 730/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:04.917514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88ef7-f238-4622-9a21-bd30c4db7620 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:04.918045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88ef7-f238-4622-9a21-bd30c4db7620 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:04.918143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da88ef7-f238-4622-9a21-bd30c4db7620 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:04.919465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 711/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:04.924721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b59d0b-f322-4291-9c7d-e29e7a8644cd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:04.925122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b59d0b-f322-4291-9c7d-e29e7a8644cd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:04.925283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b59d0b-f322-4291-9c7d-e29e7a8644cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:04.945087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-69b59d0b-f322-4291-9c7d-e29e7a8644cd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:04.946398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-69b59d0b-f322-4291-9c7d-e29e7a8644cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:04.954342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 731/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:04.992975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88ef7-f238-4622-9a21-bd30c4db7620 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:05.003880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da88ef7-f238-4622-9a21-bd30c4db7620 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:05.007417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9562015-21e8-4606-8c00-83b30fe6805e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:05.008071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9562015-21e8-4606-8c00-83b30fe6805e service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:05.008354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9562015-21e8-4606-8c00-83b30fe6805e service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:05.008652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9562015-21e8-4606-8c00-83b30fe6805e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:05.017333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9562015-21e8-4606-8c00-83b30fe6805e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:05.018818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9562015-21e8-4606-8c00-83b30fe6805e service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:05.028549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 712/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:07.283689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062edcf-0b32-4d79-82ee-027a81aa5e49 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:07.284320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062edcf-0b32-4d79-82ee-027a81aa5e49 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:07.284320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062edcf-0b32-4d79-82ee-027a81aa5e49 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:07.286440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 732/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:07.291609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4dcec-6560-4d77-bee9-d973a5d0d3bf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:07.292015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4dcec-6560-4d77-bee9-d973a5d0d3bf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:07.292158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4dcec-6560-4d77-bee9-d973a5d0d3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:07.309357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4cd4dcec-6560-4d77-bee9-d973a5d0d3bf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:07.310537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4cd4dcec-6560-4d77-bee9-d973a5d0d3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:07.318534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 713/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:07.355980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062edcf-0b32-4d79-82ee-027a81aa5e49 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:07.366307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062edcf-0b32-4d79-82ee-027a81aa5e49 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:07.369773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16094d8-7508-4254-a305-c0f0a77cad85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:07.370372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16094d8-7508-4254-a305-c0f0a77cad85 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:07.370650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16094d8-7508-4254-a305-c0f0a77cad85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:07.370922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16094d8-7508-4254-a305-c0f0a77cad85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:07.379524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16094d8-7508-4254-a305-c0f0a77cad85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:07.380966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16094d8-7508-4254-a305-c0f0a77cad85 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:07.389990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 733/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:09.885082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e2c00-98f1-4c11-a8ba-8167dd987542 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:09.885623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e2c00-98f1-4c11-a8ba-8167dd987542 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:09.885623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e2c00-98f1-4c11-a8ba-8167dd987542 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:09.886987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 714/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:09.892212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ccc97-2627-413d-839d-f2f02289aa5d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:09.892629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ccc97-2627-413d-839d-f2f02289aa5d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:09.892788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ccc97-2627-413d-839d-f2f02289aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:09.909903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-de0ccc97-2627-413d-839d-f2f02289aa5d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:09.911619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-de0ccc97-2627-413d-839d-f2f02289aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:09.919217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 734/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:09.957212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e2c00-98f1-4c11-a8ba-8167dd987542 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:09.967663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e2c00-98f1-4c11-a8ba-8167dd987542 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:09.971150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402ffc8-9c63-4987-b105-0c9b98c74be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:09.971771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ffc8-9c63-4987-b105-0c9b98c74be6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:09.972055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ffc8-9c63-4987-b105-0c9b98c74be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:09.972331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402ffc8-9c63-4987-b105-0c9b98c74be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:09.981553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ffc8-9c63-4987-b105-0c9b98c74be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:09.982952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402ffc8-9c63-4987-b105-0c9b98c74be6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:09.992712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 715/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:12.263266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106da9b4-2fef-422f-88a9-e8aa57c91133 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:12.263809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106da9b4-2fef-422f-88a9-e8aa57c91133 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:12.263809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106da9b4-2fef-422f-88a9-e8aa57c91133 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:12.265200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 735/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:12.270892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8b20-c971-48ae-b48a-d44e1814be6d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:12.271300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8b20-c971-48ae-b48a-d44e1814be6d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:12.271452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e8b20-c971-48ae-b48a-d44e1814be6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:12.289249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-055e8b20-c971-48ae-b48a-d44e1814be6d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:12.290432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-055e8b20-c971-48ae-b48a-d44e1814be6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:12.298104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 716/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:12.336152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106da9b4-2fef-422f-88a9-e8aa57c91133 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:12.346722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106da9b4-2fef-422f-88a9-e8aa57c91133 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:12.350405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8463c-4ff1-4de4-9bf4-ab1b749a2748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:12.351028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8463c-4ff1-4de4-9bf4-ab1b749a2748 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:12.351311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8463c-4ff1-4de4-9bf4-ab1b749a2748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:12.351584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8463c-4ff1-4de4-9bf4-ab1b749a2748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:12.360228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8463c-4ff1-4de4-9bf4-ab1b749a2748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:12.361678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8463c-4ff1-4de4-9bf4-ab1b749a2748 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:12.370932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 736/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:14.536831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b36ae-abad-4cf7-9711-1b64c42461a9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:14.537405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b36ae-abad-4cf7-9711-1b64c42461a9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:14.537405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b36ae-abad-4cf7-9711-1b64c42461a9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:14.538821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 717/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:14.544724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7913-d6da-47b7-9ddc-ee82e0d82012 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:14.544724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7913-d6da-47b7-9ddc-ee82e0d82012 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:14.545186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f7913-d6da-47b7-9ddc-ee82e0d82012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:14.564029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3b0f7913-d6da-47b7-9ddc-ee82e0d82012 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:14.565251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3b0f7913-d6da-47b7-9ddc-ee82e0d82012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:14.573293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 737/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:14.611909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b36ae-abad-4cf7-9711-1b64c42461a9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:14.614226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-842b36ae-abad-4cf7-9711-1b64c42461a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:14.626929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b36ae-abad-4cf7-9711-1b64c42461a9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:14.630432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e649f7-ca27-40c7-98f6-04719e757300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:14.631059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e649f7-ca27-40c7-98f6-04719e757300 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:14.631341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e649f7-ca27-40c7-98f6-04719e757300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:14.631614 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e649f7-ca27-40c7-98f6-04719e757300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:14.640272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e649f7-ca27-40c7-98f6-04719e757300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:14.641720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e649f7-ca27-40c7-98f6-04719e757300 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:14.651561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 718/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:16.852283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c472-2e98-47b9-837a-91845b2700d0 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:16.852872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c472-2e98-47b9-837a-91845b2700d0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:16.852872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72c472-2e98-47b9-837a-91845b2700d0 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:16.854174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 738/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:16.859455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4006f7-ee85-4bed-a961-9c8dfcfe530b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:16.859869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4006f7-ee85-4bed-a961-9c8dfcfe530b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:16.860010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4006f7-ee85-4bed-a961-9c8dfcfe530b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:16.877889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4c4006f7-ee85-4bed-a961-9c8dfcfe530b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:16.879120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4c4006f7-ee85-4bed-a961-9c8dfcfe530b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:16.891277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 719/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:16.934069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c472-2e98-47b9-837a-91845b2700d0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:16.944953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72c472-2e98-47b9-837a-91845b2700d0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:16.948421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81633773-7858-4476-8c3e-f8ab85de2f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:16.949152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633773-7858-4476-8c3e-f8ab85de2f56 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:16.949431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633773-7858-4476-8c3e-f8ab85de2f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:16.949704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81633773-7858-4476-8c3e-f8ab85de2f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:16.958964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81633773-7858-4476-8c3e-f8ab85de2f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:16.960370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81633773-7858-4476-8c3e-f8ab85de2f56 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:16.969574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 739/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:19.131128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196e0c-7aa0-41c3-bc1a-9906cb1d7933 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:19.131703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196e0c-7aa0-41c3-bc1a-9906cb1d7933 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:19.131703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1196e0c-7aa0-41c3-bc1a-9906cb1d7933 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:19.133079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 720/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:19.138281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ccd8-6fa2-4cd9-979b-d3ba138aa944 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:19.138685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ccd8-6fa2-4cd9-979b-d3ba138aa944 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:19.138829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10ccd8-6fa2-4cd9-979b-d3ba138aa944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:19.156532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6d10ccd8-6fa2-4cd9-979b-d3ba138aa944 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:19.157810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6d10ccd8-6fa2-4cd9-979b-d3ba138aa944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:19.165650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 740/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:19.203979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196e0c-7aa0-41c3-bc1a-9906cb1d7933 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:19.214473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1196e0c-7aa0-41c3-bc1a-9906cb1d7933 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:19.217919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528eb9f4-2d6f-44e4-8e70-3623b38d57f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:19.218537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eb9f4-2d6f-44e4-8e70-3623b38d57f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:19.218819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eb9f4-2d6f-44e4-8e70-3623b38d57f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:19.219089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528eb9f4-2d6f-44e4-8e70-3623b38d57f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:19.227744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eb9f4-2d6f-44e4-8e70-3623b38d57f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:19.229196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528eb9f4-2d6f-44e4-8e70-3623b38d57f0 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:19.238727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 721/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:21.368139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8b65-11af-4533-8909-f03054020663 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:21.368742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8b65-11af-4533-8909-f03054020663 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:21.368854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f8b65-11af-4533-8909-f03054020663 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:21.370281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 741/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:21.375580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c98d71-15a7-449e-8390-ba9cb6965bac None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:21.375998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c98d71-15a7-449e-8390-ba9cb6965bac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:21.376181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c98d71-15a7-449e-8390-ba9cb6965bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:21.382651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=79 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:29:21.394745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a9c98d71-15a7-449e-8390-ba9cb6965bac None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:21.395993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a9c98d71-15a7-449e-8390-ba9cb6965bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:21.403774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 722/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:21.440374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8b65-11af-4533-8909-f03054020663 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:21.446634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=73 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:29:21.452398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f8b65-11af-4533-8909-f03054020663 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:21.455922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722b5c8-9bb7-4db9-9bfd-56bb2ca92c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:21.456571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722b5c8-9bb7-4db9-9bfd-56bb2ca92c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:21.456901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722b5c8-9bb7-4db9-9bfd-56bb2ca92c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:21.457198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722b5c8-9bb7-4db9-9bfd-56bb2ca92c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:21.466039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722b5c8-9bb7-4db9-9bfd-56bb2ca92c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:21.467436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722b5c8-9bb7-4db9-9bfd-56bb2ca92c1d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:21.476982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 742/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:23.578856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11da0-943a-4ae7-b6f9-31f8d8f10758 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:23.579329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11da0-943a-4ae7-b6f9-31f8d8f10758 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:23.579425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11da0-943a-4ae7-b6f9-31f8d8f10758 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:23.580888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 723/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:23.586106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af959-c986-4d25-b19c-7b2e14d36f3c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:23.586536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af959-c986-4d25-b19c-7b2e14d36f3c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:23.586669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af959-c986-4d25-b19c-7b2e14d36f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:23.604280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ce6af959-c986-4d25-b19c-7b2e14d36f3c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:23.605574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce6af959-c986-4d25-b19c-7b2e14d36f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:23.613879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 743/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:23.649743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11da0-943a-4ae7-b6f9-31f8d8f10758 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:23.660960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11da0-943a-4ae7-b6f9-31f8d8f10758 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:23.664488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e84a8b-c95a-4d3f-8fcb-4bef1a5fa85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:23.665160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84a8b-c95a-4d3f-8fcb-4bef1a5fa85a service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:23.665450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84a8b-c95a-4d3f-8fcb-4bef1a5fa85a service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:23.665726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e84a8b-c95a-4d3f-8fcb-4bef1a5fa85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:23.674557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e84a8b-c95a-4d3f-8fcb-4bef1a5fa85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:23.675996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e84a8b-c95a-4d3f-8fcb-4bef1a5fa85a service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:23.685330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 724/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:25.797125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447751-ff48-4e91-a6fe-2e7d7620b651 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:25.797646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447751-ff48-4e91-a6fe-2e7d7620b651 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:25.797646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2447751-ff48-4e91-a6fe-2e7d7620b651 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:25.799025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 744/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:25.804219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7edcf3-4711-441f-9352-e98ae007d9db None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:25.804669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7edcf3-4711-441f-9352-e98ae007d9db None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:25.804808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7edcf3-4711-441f-9352-e98ae007d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:25.822124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6b7edcf3-4711-441f-9352-e98ae007d9db None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:25.823416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b7edcf3-4711-441f-9352-e98ae007d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:25.831810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 725/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:25.868129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447751-ff48-4e91-a6fe-2e7d7620b651 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:25.878803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2447751-ff48-4e91-a6fe-2e7d7620b651 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:25.882280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb8c2e-08d1-4bc6-a828-28ccb7e18ee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:25.882900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb8c2e-08d1-4bc6-a828-28ccb7e18ee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:25.883177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb8c2e-08d1-4bc6-a828-28ccb7e18ee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:25.883449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb8c2e-08d1-4bc6-a828-28ccb7e18ee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:25.892057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb8c2e-08d1-4bc6-a828-28ccb7e18ee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:25.893487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb8c2e-08d1-4bc6-a828-28ccb7e18ee6 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:25.903272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 745/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:35.817349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=11 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:29:35.899099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=14 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:29:46.784634 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c507b-4f2f-4f05-b70f-b068b6d6cad9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:46.785234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c507b-4f2f-4f05-b70f-b068b6d6cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:46.785234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c507b-4f2f-4f05-b70f-b068b6d6cad9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:46.786549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 726/1471] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:46.791796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491210f-4884-4cbf-bd4e-cc71040a76b1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:46.792268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491210f-4884-4cbf-bd4e-cc71040a76b1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:46.792381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491210f-4884-4cbf-bd4e-cc71040a76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:46.810172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9491210f-4884-4cbf-bd4e-cc71040a76b1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:46.811292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9491210f-4884-4cbf-bd4e-cc71040a76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:46.820017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 746/1472] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:46.866622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a527-9e4a-4374-bd30-d5a364b850c3 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:46.866907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a527-9e4a-4374-bd30-d5a364b850c3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:46.867230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207a527-9e4a-4374-bd30-d5a364b850c3 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:46.868637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 727/1473] 10.222.0.65 () {54 vars in 962 bytes} [Thu Jun 16 20:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:46.873495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e65f-0f33-47bc-896e-28b9fe03de83 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:46.881260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e65f-0f33-47bc-896e-28b9fe03de83 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:46.881260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807e65f-0f33-47bc-896e-28b9fe03de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:46.892272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8807e65f-0f33-47bc-896e-28b9fe03de83 None None] MFA Rules not processed for user `37174d8d343d4989a8c41b4d43246c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:46.893497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8807e65f-0f33-47bc-896e-28b9fe03de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:46.900010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 747/1474] 10.222.0.65 () {58 vars in 1059 bytes} [Thu Jun 16 20:29:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:46.907191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a527-9e4a-4374-bd30-d5a364b850c3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:46.918114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207a527-9e4a-4374-bd30-d5a364b850c3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:46.922468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb6e73-4734-4d2e-9daa-3b87b8d8f253 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:46.922468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6e73-4734-4d2e-9daa-3b87b8d8f253 service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:46.922468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6e73-4734-4d2e-9daa-3b87b8d8f253 service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:46.922949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb6e73-4734-4d2e-9daa-3b87b8d8f253 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:46.931916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6e73-4734-4d2e-9daa-3b87b8d8f253 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:46.933605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb6e73-4734-4d2e-9daa-3b87b8d8f253 service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:46.942998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 728/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:49.145231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5701-f81e-4223-9800-eb3d3ac149ba None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:49.145810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5701-f81e-4223-9800-eb3d3ac149ba None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:49.145810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a5701-f81e-4223-9800-eb3d3ac149ba None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:49.147155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 748/1476] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:49.152224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70347892-8622-4d80-a7b5-b124460388b1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:49.152683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70347892-8622-4d80-a7b5-b124460388b1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:49.152792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70347892-8622-4d80-a7b5-b124460388b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:49.170702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-70347892-8622-4d80-a7b5-b124460388b1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:49.171889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-70347892-8622-4d80-a7b5-b124460388b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:49.180235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 729/1477] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:49.202986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a5701-f81e-4223-9800-eb3d3ac149ba None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:49.215186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a5701-f81e-4223-9800-eb3d3ac149ba None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:49.219553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:49.220182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:49.220461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:49.220774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:49.222061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:49.223786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:29:49.223786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:29:49.223786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:29:49.224974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309ba78-2c5e-40c4-b324-519f762b0a87 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:49.243792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 749/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Thu Jun 16 20:29:49 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:29:51.362111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93847-64ff-438b-877b-e7f71099f86e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:51.362685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93847-64ff-438b-877b-e7f71099f86e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:51.362685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea93847-64ff-438b-877b-e7f71099f86e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:51.364020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 730/1479] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:51.369234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555922d5-258f-4851-a4e3-1748c154e083 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:51.369647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555922d5-258f-4851-a4e3-1748c154e083 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:51.369789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555922d5-258f-4851-a4e3-1748c154e083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:51.387901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-555922d5-258f-4851-a4e3-1748c154e083 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:51.389135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-555922d5-258f-4851-a4e3-1748c154e083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:51.396772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 750/1480] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:51.440085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea93847-64ff-438b-877b-e7f71099f86e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:51.453913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea93847-64ff-438b-877b-e7f71099f86e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:51.459263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe9876-ec03-4edc-baec-899e1817db89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:51.459881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9876-ec03-4edc-baec-899e1817db89 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:51.460159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9876-ec03-4edc-baec-899e1817db89 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:51.460433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe9876-ec03-4edc-baec-899e1817db89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:51.468466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe9876-ec03-4edc-baec-899e1817db89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:51.470213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe9876-ec03-4edc-baec-899e1817db89 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:51.480297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 731/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:53.760234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756366-f3a4-4128-9fb0-3d016ff8c6f7 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:53.764133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756366-f3a4-4128-9fb0-3d016ff8c6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:53.764133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f756366-f3a4-4128-9fb0-3d016ff8c6f7 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:53.764133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 751/1482] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:53.767732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594aee9-9eb7-4b27-8265-afd6dae8893d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:53.768149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594aee9-9eb7-4b27-8265-afd6dae8893d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:53.768286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594aee9-9eb7-4b27-8265-afd6dae8893d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:53.787023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6594aee9-9eb7-4b27-8265-afd6dae8893d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:53.788195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6594aee9-9eb7-4b27-8265-afd6dae8893d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:53.795980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 732/1483] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:29:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:53.832289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f756366-f3a4-4128-9fb0-3d016ff8c6f7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:53.842839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f756366-f3a4-4128-9fb0-3d016ff8c6f7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:53.846831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04269286-2f29-4493-96c3-06d5a8b06e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:53.847458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04269286-2f29-4493-96c3-06d5a8b06e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:53.847738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04269286-2f29-4493-96c3-06d5a8b06e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:53.848011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04269286-2f29-4493-96c3-06d5a8b06e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:53.856744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04269286-2f29-4493-96c3-06d5a8b06e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:53.858172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04269286-2f29-4493-96c3-06d5a8b06e77 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:53.867985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 752/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:56.055516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bcd2-8d3a-473f-b28b-67f27e7d1172 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:56.056096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bcd2-8d3a-473f-b28b-67f27e7d1172 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:56.056096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263bcd2-8d3a-473f-b28b-67f27e7d1172 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:56.057441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 733/1485] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:56.062713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c87a25-1208-4263-98fb-08eb4e22cf87 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:56.063127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c87a25-1208-4263-98fb-08eb4e22cf87 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:56.063300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c87a25-1208-4263-98fb-08eb4e22cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:56.081575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-25c87a25-1208-4263-98fb-08eb4e22cf87 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:56.082770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-25c87a25-1208-4263-98fb-08eb4e22cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:56.090705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 753/1486] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:56.128132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263bcd2-8d3a-473f-b28b-67f27e7d1172 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:56.138615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263bcd2-8d3a-473f-b28b-67f27e7d1172 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:56.142091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ae8e0-bf7e-411a-a737-b0732f3d0671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:56.143337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ae8e0-bf7e-411a-a737-b0732f3d0671 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:56.143619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ae8e0-bf7e-411a-a737-b0732f3d0671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:56.143889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ae8e0-bf7e-411a-a737-b0732f3d0671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:56.152582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ae8e0-bf7e-411a-a737-b0732f3d0671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:56.154020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ae8e0-bf7e-411a-a737-b0732f3d0671 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:56.163205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 734/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:29:58.379674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28619038-9697-4ca7-acee-c6574caa255f None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:58.380252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28619038-9697-4ca7-acee-c6574caa255f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:58.380252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28619038-9697-4ca7-acee-c6574caa255f None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:58.381649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 754/1488] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:29:58.386881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4567a-b418-4ec4-a533-1210d5855b3e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:58.387285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4567a-b418-4ec4-a533-1210d5855b3e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:58.387450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4567a-b418-4ec4-a533-1210d5855b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:58.404801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-99f4567a-b418-4ec4-a533-1210d5855b3e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:29:58.405990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-99f4567a-b418-4ec4-a533-1210d5855b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:29:58.414326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 735/1489] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:29:58.454801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28619038-9697-4ca7-acee-c6574caa255f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:29:58.465123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28619038-9697-4ca7-acee-c6574caa255f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:29:58.468541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93d24-9763-4a3e-890e-3ee8b3c8619f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:29:58.469196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93d24-9763-4a3e-890e-3ee8b3c8619f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:29:58.469465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93d24-9763-4a3e-890e-3ee8b3c8619f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:29:58.469737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93d24-9763-4a3e-890e-3ee8b3c8619f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:29:58.478916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93d24-9763-4a3e-890e-3ee8b3c8619f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:29:58.480344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93d24-9763-4a3e-890e-3ee8b3c8619f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:29:58.490388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 755/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:30:01.066046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78355d62-9cd0-4571-aa08-bd223ccd0d60 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:30:01.066625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78355d62-9cd0-4571-aa08-bd223ccd0d60 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:30:01.066625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78355d62-9cd0-4571-aa08-bd223ccd0d60 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:30:01.068007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 736/1491] 10.222.0.65 () {54 vars in 926 bytes} [Thu Jun 16 20:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:30:01.073157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8729-210a-4675-80a9-9f9d358d3493 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:30:01.073563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8729-210a-4675-80a9-9f9d358d3493 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:30:01.073710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8729-210a-4675-80a9-9f9d358d3493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:30:01.091379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-713c8729-210a-4675-80a9-9f9d358d3493 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:30:01.092556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-713c8729-210a-4675-80a9-9f9d358d3493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:30:01.100881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 756/1492] 10.222.0.65 () {58 vars in 1023 bytes} [Thu Jun 16 20:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:30:01.138856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78355d62-9cd0-4571-aa08-bd223ccd0d60 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:30:01.149977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78355d62-9cd0-4571-aa08-bd223ccd0d60 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:30:01.153437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48a2e2-27b6-48e8-8e3f-86c26b9fa8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:30:01.154056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a2e2-27b6-48e8-8e3f-86c26b9fa8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:30:01.154331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a2e2-27b6-48e8-8e3f-86c26b9fa8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:30:01.154600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48a2e2-27b6-48e8-8e3f-86c26b9fa8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:30:01.163685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48a2e2-27b6-48e8-8e3f-86c26b9fa8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:30:01.165476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48a2e2-27b6-48e8-8e3f-86c26b9fa8a6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:30:01.174684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 737/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:30:11.086481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=33 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:30:11.170468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=33 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:31:49.324458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.325099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.325099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.354485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:31:49.355691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:49.363438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 757/1494] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:31:49.373452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.373963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.374066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.392036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:31:49.393261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:49.400985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 738/1495] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:31:49.405453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:49.414807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdc7e2-d12c-47b5-8b75-6e8b66107186 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:49.419709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:49.420348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.420651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.420930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.421644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:31:49.421950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:49.422957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:49.422957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:31:49.422957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:31:49.423839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:49.437109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 758/1496] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:31:49.444700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:49.453675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d41466-270d-4e2e-902d-bd4497f4964d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:49.458129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:49.458768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.459051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.459325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.460021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:49.461819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:49.461819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:31:49.461819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:31:49.463100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:49.628130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 739/1497] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:31:49 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:31:49.632405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:49.642235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653e80-c28c-43b4-8925-c04d24e2f09a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:49.698299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:49.698953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.699236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.699510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.700191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:49.701217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:49.701217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:31:49.701217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:31:49.702442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:49.907902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 759/1498] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:31:49 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:31:49.912183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:49.923829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171e215-73b6-4684-9636-4b07692bfc8f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:49.928374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:49.929051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.929333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.929604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.930660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:49.932010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:49.932010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:31:49.932010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:31:49.932959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:49.946465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 740/1499] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:31:49.950401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:49.960007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587456d-2618-40d5-a3bb-9de345e77893 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:49.965440 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:49.966116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:49.966396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:49.966670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:49.967437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:49.968427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:49.968427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:31:49.968427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:31:49.969386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb863e7-ba3b-4ffc-96d8-f57d8a8ca7ad admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:49.984113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 760/1500] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:31:49.988210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:49.998086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266f79e-bb98-4cac-9a5b-a3ba2d385342 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:50.003177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:50.004043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.004321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.004590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] PATH_INFO: `/v3/projects/58452481189146399f3e7ef0b7f02a3f/users/fc33998aea1d42cd92edcd9460a75c6d/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.019629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58452481189146399f3e7ef0b7f02a3f, user_id=fc33998aea1d42cd92edcd9460a75c6d, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:50.020669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:50.020669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:31:50.020669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:31:50.022569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fba9458-2fdd-44ff-b0ee-8fe7183f529c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:50.095042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 741/1501] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:31:49 2022] PUT /identity/v3/projects/58452481189146399f3e7ef0b7f02a3f/users/fc33998aea1d42cd92edcd9460a75c6d/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:31:50.107004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227da69-4375-487b-a390-0697462973f1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.107293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227da69-4375-487b-a390-0697462973f1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.107592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4227da69-4375-487b-a390-0697462973f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.132715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4227da69-4375-487b-a390-0697462973f1 None None] MFA Rules not processed for user `fc33998aea1d42cd92edcd9460a75c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:31:50.133923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4227da69-4375-487b-a390-0697462973f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:50.197576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 761/1502] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:31:50.210394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3494e-07ca-4b19-a629-64478937bf8b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.210688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3494e-07ca-4b19-a629-64478937bf8b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.210999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3494e-07ca-4b19-a629-64478937bf8b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.213020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 742/1503] 10.222.0.65 () {54 vars in 963 bytes} [Thu Jun 16 20:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:31:50.217826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de490a7-be5d-41c0-bf2f-6951b66bc6bc None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.218119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de490a7-be5d-41c0-bf2f-6951b66bc6bc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.218398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de490a7-be5d-41c0-bf2f-6951b66bc6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.236372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3de490a7-be5d-41c0-bf2f-6951b66bc6bc None None] MFA Rules not processed for user `21161c14bb024771be73ce9248ef515c`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:31:50.237586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3de490a7-be5d-41c0-bf2f-6951b66bc6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:50.279546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:31:50.286288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 762/1504] 10.222.0.65 () {58 vars in 1060 bytes} [Thu Jun 16 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:31:50.293794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3494e-07ca-4b19-a629-64478937bf8b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:50.304216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3494e-07ca-4b19-a629-64478937bf8b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:50.308119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:50.308779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.309066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.309343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.317363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:50.318775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:50.328092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 743/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:31:50.369450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d51f6-c3c6-488d-8168-27e575e2a062 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.369881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d51f6-c3c6-488d-8168-27e575e2a062 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.369985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d51f6-c3c6-488d-8168-27e575e2a062 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.371277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 763/1506] 10.222.0.65 () {52 vars in 829 bytes} [Thu Jun 16 20:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:31:50.374823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:50.436124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6982208-54d3-4d9e-88b3-390edd3487a0 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:50.440641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:50.441512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.441796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.442071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] PATH_INFO: `/v3/users/fc33998aea1d42cd92edcd9460a75c6d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.443248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc33998aea1d42cd92edcd9460a75c6d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:50.444256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:50.444256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:31:50.444256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:31:50.445489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:50.730292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc33998aea1d42cd92edcd9460a75c6d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:50.748389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc33998aea1d42cd92edcd9460a75c6d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:50.749123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc33998aea1d42cd92edcd9460a75c6d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:50.761479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc33998aea1d42cd92edcd9460a75c6d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:50.765411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:31:50.832158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc33998aea1d42cd92edcd9460a75c6d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:50.839130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 744/1507] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:31:50 2022] DELETE /identity/v3/users/fc33998aea1d42cd92edcd9460a75c6d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:31:50.843662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.843947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.844259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:50.862024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:31:50.863199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:50.921283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 764/1508] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:31:50.930674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:50.937713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:50.989764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca88546-243c-4e16-b125-56a2cf46de4e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:50.993361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d262f4a-8cda-41c3-b484-567b5bfded43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:50.993998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262f4a-8cda-41c3-b484-567b5bfded43 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:50.994284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262f4a-8cda-41c3-b484-567b5bfded43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:50.994561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d262f4a-8cda-41c3-b484-567b5bfded43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:51.003733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262f4a-8cda-41c3-b484-567b5bfded43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:51.005207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d262f4a-8cda-41c3-b484-567b5bfded43 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:51.015035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 745/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:31:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:31:51.640469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:31:51.641962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:31:51.653862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd1ec3-fb4f-4766-8397-d6be4a928ee4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:31:51.658854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:31:51.661287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:31:51.661912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:31:51.662288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] PATH_INFO: `/v3/projects/58452481189146399f3e7ef0b7f02a3f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:31:51.663508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58452481189146399f3e7ef0b7f02a3f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:31:51.664523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:31:51.664523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:31:51.664523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:31:51.667596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:31:51.904219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58452481189146399f3e7ef0b7f02a3f', 'request_id': 'req-564e8956-a6b3-47c1-8b59-a409537dac27'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:51.918498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58452481189146399f3e7ef0b7f02a3f', 'request_id': 'req-564e8956-a6b3-47c1-8b59-a409537dac27'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:52.054849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58452481189146399f3e7ef0b7f02a3f', 'request_id': 'req-564e8956-a6b3-47c1-8b59-a409537dac27'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:52.066988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] The token cache is being invalidate because project 58452481189146399f3e7ef0b7f02a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:31:52.083812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:52.083812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-564e8956-a6b3-47c1-8b59-a409537dac27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:31:52.083812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 765/1510] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:31:51 2022] DELETE /identity/v3/projects/58452481189146399f3e7ef0b7f02a3f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:32:01.010850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:32:02.063849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:33:37.239353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da0709-ffd0-47b1-b513-18d7b06dfc13 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:37.239925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da0709-ffd0-47b1-b513-18d7b06dfc13 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:37.239925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da0709-ffd0-47b1-b513-18d7b06dfc13 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:37.241381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 746/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:37.246387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6ee20-d73b-4953-ad3e-bca3e2aaa971 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:37.246793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6ee20-d73b-4953-ad3e-bca3e2aaa971 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:37.246960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6ee20-d73b-4953-ad3e-bca3e2aaa971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:37.264964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0df6ee20-d73b-4953-ad3e-bca3e2aaa971 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:37.266174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0df6ee20-d73b-4953-ad3e-bca3e2aaa971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:37.327060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 766/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:37.496747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da0709-ffd0-47b1-b513-18d7b06dfc13 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:37.503546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-57da0709-ffd0-47b1-b513-18d7b06dfc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:37.575969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da0709-ffd0-47b1-b513-18d7b06dfc13 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:37.582143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07186894-32fe-4cf3-9c8d-205a1f2b9a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:37.582789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186894-32fe-4cf3-9c8d-205a1f2b9a1b service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:37.583075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186894-32fe-4cf3-9c8d-205a1f2b9a1b service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:37.583352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07186894-32fe-4cf3-9c8d-205a1f2b9a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:37.591497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186894-32fe-4cf3-9c8d-205a1f2b9a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:37.593099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07186894-32fe-4cf3-9c8d-205a1f2b9a1b service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:37.602390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 747/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:33:38.478146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d34b7-edd0-40db-aff3-020333108fff None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:38.478717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d34b7-edd0-40db-aff3-020333108fff None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:38.478717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d34b7-edd0-40db-aff3-020333108fff None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:38.480060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 767/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:38.484824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ac66-fe73-425d-af6d-f0dceb6e1a30 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:38.485256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ac66-fe73-425d-af6d-f0dceb6e1a30 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:38.485382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39ac66-fe73-425d-af6d-f0dceb6e1a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:38.504073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5b39ac66-fe73-425d-af6d-f0dceb6e1a30 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:38.505297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5b39ac66-fe73-425d-af6d-f0dceb6e1a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:38.513013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 748/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:38.665217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d34b7-edd0-40db-aff3-020333108fff None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:38.680140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d34b7-edd0-40db-aff3-020333108fff None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:38.685551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ec368-7d56-4aaa-b896-7dc27febab46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:38.686178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec368-7d56-4aaa-b896-7dc27febab46 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:38.686465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec368-7d56-4aaa-b896-7dc27febab46 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:38.686737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ec368-7d56-4aaa-b896-7dc27febab46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:38.695332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ec368-7d56-4aaa-b896-7dc27febab46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:38.696952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ec368-7d56-4aaa-b896-7dc27febab46 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:38.706168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 768/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:33:38.862681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a216-6bbc-4073-bd19-71933dd07199 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:38.862969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a216-6bbc-4073-bd19-71933dd07199 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:38.863249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2a216-6bbc-4073-bd19-71933dd07199 None None] PATH_INFO: `/v3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:38.864562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 749/1517] 10.222.0.71 () {54 vars in 925 bytes} [Thu Jun 16 20:33:38 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:33:38.870334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985dcc-ebba-4661-91b9-4db7beee5f57 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:38.870618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985dcc-ebba-4661-91b9-4db7beee5f57 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:38.870894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be985dcc-ebba-4661-91b9-4db7beee5f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:39.010048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-be985dcc-ebba-4661-91b9-4db7beee5f57 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:39.011202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-be985dcc-ebba-4661-91b9-4db7beee5f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:39.079192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 769/1518] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Jun 16 20:33:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:42.995880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb26f-c5e6-4bf4-a300-47dc75802af9 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:42.996483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb26f-c5e6-4bf4-a300-47dc75802af9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:42.996483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb26f-c5e6-4bf4-a300-47dc75802af9 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:42.997839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 750/1519] 10.222.0.65 () {54 vars in 960 bytes} [Thu Jun 16 20:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:43.003592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0ca55-8ffe-4007-8d33-8bfcc8c2a1e7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:43.004026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0ca55-8ffe-4007-8d33-8bfcc8c2a1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:43.004260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0ca55-8ffe-4007-8d33-8bfcc8c2a1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:43.022201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9ed0ca55-8ffe-4007-8d33-8bfcc8c2a1e7 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:43.023389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9ed0ca55-8ffe-4007-8d33-8bfcc8c2a1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:43.031732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 770/1520] 10.222.0.65 () {58 vars in 1057 bytes} [Thu Jun 16 20:33:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:43.039908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb26f-c5e6-4bf4-a300-47dc75802af9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:43.053180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb26f-c5e6-4bf4-a300-47dc75802af9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:43.057965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0776b-a790-443c-9447-51fbfdcfdcf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:43.058589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0776b-a790-443c-9447-51fbfdcfdcf9 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:43.058865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0776b-a790-443c-9447-51fbfdcfdcf9 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:43.059135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0776b-a790-443c-9447-51fbfdcfdcf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:43.067267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0776b-a790-443c-9447-51fbfdcfdcf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:43.068887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca0776b-a790-443c-9447-51fbfdcfdcf9 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:43.079318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 751/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:33:49.992986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739b67-daa1-4404-96f6-aef62ed268f2 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:49.993556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739b67-daa1-4404-96f6-aef62ed268f2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:49.993556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97739b67-daa1-4404-96f6-aef62ed268f2 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:49.994904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:49.999854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f7a0-39f6-4b6c-ab18-be475b95c340 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:50.000289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f7a0-39f6-4b6c-ab18-be475b95c340 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:50.000398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15f7a0-39f6-4b6c-ab18-be475b95c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:50.019159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0e15f7a0-39f6-4b6c-ab18-be475b95c340 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:50.020372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0e15f7a0-39f6-4b6c-ab18-be475b95c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:50.028402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:50.182832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739b67-daa1-4404-96f6-aef62ed268f2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:50.197209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97739b67-daa1-4404-96f6-aef62ed268f2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:50.203823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154d305-d6ef-44f1-886e-6d991f1f37a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:50.203823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d305-d6ef-44f1-886e-6d991f1f37a6 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:50.203823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d305-d6ef-44f1-886e-6d991f1f37a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:50.204282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d305-d6ef-44f1-886e-6d991f1f37a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:50.212034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154d305-d6ef-44f1-886e-6d991f1f37a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:50.213645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154d305-d6ef-44f1-886e-6d991f1f37a6 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:50.225478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 772/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:33:51.095693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5768937-37f8-4df7-862e-05d529cf63e3 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:51.096229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5768937-37f8-4df7-862e-05d529cf63e3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:51.096229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5768937-37f8-4df7-862e-05d529cf63e3 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:51.097571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:51.102388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6639-742e-4646-bfea-0dcb3d4d1bd1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:51.102811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6639-742e-4646-bfea-0dcb3d4d1bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:51.102940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6639-742e-4646-bfea-0dcb3d4d1bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:51.120864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c55c6639-742e-4646-bfea-0dcb3d4d1bd1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:51.122042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c55c6639-742e-4646-bfea-0dcb3d4d1bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:51.129786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 20:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:33:51.282696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5768937-37f8-4df7-862e-05d529cf63e3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:51.297298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5768937-37f8-4df7-862e-05d529cf63e3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:51.302512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae326f-ff86-4644-b584-3fbed9ac70ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:51.303129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae326f-ff86-4644-b584-3fbed9ac70ec service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:51.303410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae326f-ff86-4644-b584-3fbed9ac70ec service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:51.303682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae326f-ff86-4644-b584-3fbed9ac70ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:51.311524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae326f-ff86-4644-b584-3fbed9ac70ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:51.313639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae326f-ff86-4644-b584-3fbed9ac70ec service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:51.322987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 754/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:33:55.287669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0528f7-1a34-4bc8-889f-f43908f95551 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:55.288301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0528f7-1a34-4bc8-889f-f43908f95551 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:55.288301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0528f7-1a34-4bc8-889f-f43908f95551 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:55.289607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:55.294583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817a5c-d538-437e-ad6c-5ae23f84c7bc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:55.295038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817a5c-d538-437e-ad6c-5ae23f84c7bc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:55.295156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb817a5c-d538-437e-ad6c-5ae23f84c7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:55.313299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-cb817a5c-d538-437e-ad6c-5ae23f84c7bc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:55.314478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cb817a5c-d538-437e-ad6c-5ae23f84c7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:55.322240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:55.358495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0528f7-1a34-4bc8-889f-f43908f95551 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:55.360150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0b0528f7-1a34-4bc8-889f-f43908f95551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:55.420337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0528f7-1a34-4bc8-889f-f43908f95551 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:55.424755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e0cb1-6324-4f52-afee-67dca1e6a133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:55.425420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e0cb1-6324-4f52-afee-67dca1e6a133 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:55.425707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e0cb1-6324-4f52-afee-67dca1e6a133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:55.425991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e0cb1-6324-4f52-afee-67dca1e6a133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:55.435459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e0cb1-6324-4f52-afee-67dca1e6a133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:55.437448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e0cb1-6324-4f52-afee-67dca1e6a133 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:55.442342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:33:55.447900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 775/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:33:57.584967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcbdc6-8bc2-4822-a3db-86163778b6ad None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:57.585509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcbdc6-8bc2-4822-a3db-86163778b6ad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:57.585509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcbdc6-8bc2-4822-a3db-86163778b6ad None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:57.586964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:33:57.592127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c8bb5-0376-4c9f-9544-98a43d787581 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:57.592567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c8bb5-0376-4c9f-9544-98a43d787581 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:57.592742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c8bb5-0376-4c9f-9544-98a43d787581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:57.610556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f58c8bb5-0376-4c9f-9544-98a43d787581 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:33:57.611743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f58c8bb5-0376-4c9f-9544-98a43d787581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:33:57.619493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:33:57.655990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcbdc6-8bc2-4822-a3db-86163778b6ad None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:33:57.666732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcbdc6-8bc2-4822-a3db-86163778b6ad None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:33:57.670210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0752f-2a94-4454-9f4c-ec3e1618a72e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:33:57.671094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0752f-2a94-4454-9f4c-ec3e1618a72e service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:33:57.671374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0752f-2a94-4454-9f4c-ec3e1618a72e service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:33:57.671647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0752f-2a94-4454-9f4c-ec3e1618a72e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:33:57.680384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0752f-2a94-4454-9f4c-ec3e1618a72e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:33:57.681841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0752f-2a94-4454-9f4c-ec3e1618a72e service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:33:57.691765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 757/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:34:01.377827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77d6c-736f-481d-8c31-9b6525d9fff1 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:34:01.378430 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77d6c-736f-481d-8c31-9b6525d9fff1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:34:01.378430 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c77d6c-736f-481d-8c31-9b6525d9fff1 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:34:01.379735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:34:01.384768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a93f-f9db-4358-ae36-eef7e04a7d7b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:34:01.385226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a93f-f9db-4358-ae36-eef7e04a7d7b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:34:01.385332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4133a93f-f9db-4358-ae36-eef7e04a7d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:34:01.392187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=62 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:34:01.403770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4133a93f-f9db-4358-ae36-eef7e04a7d7b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:34:01.405612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4133a93f-f9db-4358-ae36-eef7e04a7d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:34:01.413546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:34:01.684195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c77d6c-736f-481d-8c31-9b6525d9fff1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:34:01.685970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c0c77d6c-736f-481d-8c31-9b6525d9fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:34:01.742447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c77d6c-736f-481d-8c31-9b6525d9fff1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:34:01.746087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1353ae-bf6e-4c73-9222-1e7abdb16689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:34:01.746721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1353ae-bf6e-4c73-9222-1e7abdb16689 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:34:01.747008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1353ae-bf6e-4c73-9222-1e7abdb16689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:34:01.747332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1353ae-bf6e-4c73-9222-1e7abdb16689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:34:01.756241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1353ae-bf6e-4c73-9222-1e7abdb16689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:34:01.757684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1353ae-bf6e-4c73-9222-1e7abdb16689 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:34:01.767427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 778/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:34:03.896689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642a32-bd05-40a1-89ce-0ca6a9669666 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:34:03.897256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642a32-bd05-40a1-89ce-0ca6a9669666 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:34:03.897256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84642a32-bd05-40a1-89ce-0ca6a9669666 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:34:03.898614 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 20:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:34:03.903766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b3668-9bd4-490b-aa83-cab9f7ce10d7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:34:03.904222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b3668-9bd4-490b-aa83-cab9f7ce10d7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:34:03.904386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b3668-9bd4-490b-aa83-cab9f7ce10d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:34:03.922802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-377b3668-9bd4-490b-aa83-cab9f7ce10d7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:34:03.923975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-377b3668-9bd4-490b-aa83-cab9f7ce10d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:34:03.932474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 20:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:34:04.198327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642a32-bd05-40a1-89ce-0ca6a9669666 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:34:04.200074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-84642a32-bd05-40a1-89ce-0ca6a9669666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:34:04.213506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84642a32-bd05-40a1-89ce-0ca6a9669666 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:34:04.217606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fce6e-ea09-4fce-bd40-44179a0765b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:34:04.218234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fce6e-ea09-4fce-bd40-44179a0765b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:34:04.218518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fce6e-ea09-4fce-bd40-44179a0765b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:34:04.218796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fce6e-ea09-4fce-bd40-44179a0765b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:34:04.227656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fce6e-ea09-4fce-bd40-44179a0765b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:34:04.229120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9fce6e-ea09-4fce-bd40-44179a0765b0 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:34:04.238631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 760/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:34:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:34:13.917707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=32 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:34:14.234442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=8 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:36.310654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.311302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.311302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.334277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.335923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.347604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 780/1540] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.358515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.359115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.359115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.389033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.390321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.404020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 761/1541] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.409461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:36.426756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dfef9-a3b4-4259-9e1f-0c9b92338517 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:36.436551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:36.437782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.438336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.438864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.440105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:36.440706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:36.442718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181983-70a8-4e5c-a9c8-8a9def4f90de admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:36.464772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 781/1542] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:36.477694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:36.500495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3cf30-94dd-4a67-8fd1-a04d42db77a2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:36.514173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f5062-7dbd-42f3-90da-b923918cdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:36.515041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f5062-7dbd-42f3-90da-b923918cdc63 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.515418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f5062-7dbd-42f3-90da-b923918cdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.515795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f5062-7dbd-42f3-90da-b923918cdc63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.516604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f5062-7dbd-42f3-90da-b923918cdc63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:36.518706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f5062-7dbd-42f3-90da-b923918cdc63 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:36.615843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508715a-cc1f-438a-8bc4-c737b4ac26e1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.616156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508715a-cc1f-438a-8bc4-c737b4ac26e1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.616444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508715a-cc1f-438a-8bc4-c737b4ac26e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.642653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3508715a-cc1f-438a-8bc4-c737b4ac26e1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.649324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3508715a-cc1f-438a-8bc4-c737b4ac26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.655559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 782/1543] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:35:36.656581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 762/1544] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:36.656885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.657174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.657456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.663920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c9da-df61-4dba-a3b3-2d0c0cdbb479 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.664196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c9da-df61-4dba-a3b3-2d0c0cdbb479 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.670011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c9da-df61-4dba-a3b3-2d0c0cdbb479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.700229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.701476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.707331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b374c9da-df61-4dba-a3b3-2d0c0cdbb479 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.709404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b374c9da-df61-4dba-a3b3-2d0c0cdbb479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.775345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 763/1545] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:35:36.778052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3abfc1-8cfb-43ed-8b20-ce4d17ba9bdf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.778343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3abfc1-8cfb-43ed-8b20-ce4d17ba9bdf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.778624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3abfc1-8cfb-43ed-8b20-ce4d17ba9bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.779930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 783/1546] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.781139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:36.791178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77959d67-ab78-4ae2-a59b-709ede2b494c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:36.795749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84caf9-f358-439c-a92b-2aa4d56956d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:36.796425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84caf9-f358-439c-a92b-2aa4d56956d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.797024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84caf9-f358-439c-a92b-2aa4d56956d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.797024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84caf9-f358-439c-a92b-2aa4d56956d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.797698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84caf9-f358-439c-a92b-2aa4d56956d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:36.800592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84caf9-f358-439c-a92b-2aa4d56956d2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:36.802550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ce3abfc1-8cfb-43ed-8b20-ce4d17ba9bdf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.803770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ce3abfc1-8cfb-43ed-8b20-ce4d17ba9bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.811909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 764/1547] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.813503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a9d2d-79ac-48c9-b79d-654bf1afad6a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.813643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a9d2d-79ac-48c9-b79d-654bf1afad6a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.813843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a9d2d-79ac-48c9-b79d-654bf1afad6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.831774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-564a9d2d-79ac-48c9-b79d-654bf1afad6a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.832908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-564a9d2d-79ac-48c9-b79d-654bf1afad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.841159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 765/1548] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.842374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb7a0-5e69-4b53-a011-d56d3797b40e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.842660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb7a0-5e69-4b53-a011-d56d3797b40e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.842932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feb7a0-5e69-4b53-a011-d56d3797b40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.860033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-50feb7a0-5e69-4b53-a011-d56d3797b40e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.861312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-50feb7a0-5e69-4b53-a011-d56d3797b40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.871744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 766/1549] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.875461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 784/1550] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:36.875608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779386e-a9e2-4f47-b0d8-a256fbe097ac None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.875608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779386e-a9e2-4f47-b0d8-a256fbe097ac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.875608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779386e-a9e2-4f47-b0d8-a256fbe097ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.875866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c399-c564-4bdf-8f23-5fa7cd418ff2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.875973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c399-c564-4bdf-8f23-5fa7cd418ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.876277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8c399-c564-4bdf-8f23-5fa7cd418ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.895200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0779386e-a9e2-4f47-b0d8-a256fbe097ac None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.897057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0779386e-a9e2-4f47-b0d8-a256fbe097ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.898389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-07f8c399-c564-4bdf-8f23-5fa7cd418ff2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.899602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-07f8c399-c564-4bdf-8f23-5fa7cd418ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.913911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 767/1551] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.913911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5495d64-e608-4d85-bbca-52e612b3d3d9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.918281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 785/1552] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.918510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5495d64-e608-4d85-bbca-52e612b3d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.918510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5495d64-e608-4d85-bbca-52e612b3d3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.918734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.918734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.918734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.934403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.935612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.937485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a5495d64-e608-4d85-bbca-52e612b3d3d9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.941372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a5495d64-e608-4d85-bbca-52e612b3d3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.943989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 786/1553] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.944879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:36.947252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 768/1554] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.950522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d19f17-d11a-4681-af6e-4dfd3fd56482 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.951036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d19f17-d11a-4681-af6e-4dfd3fd56482 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.951277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d19f17-d11a-4681-af6e-4dfd3fd56482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.955091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff664468-e862-480b-9b4b-6939c2f90e84 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:36.960398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:36.961102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.961382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.961657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.962380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:36.962684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:36.964263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:36.970041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f5d19f17-d11a-4681-af6e-4dfd3fd56482 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:36.971378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f5d19f17-d11a-4681-af6e-4dfd3fd56482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:36.976767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 787/1555] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:36.981559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:36.981749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 769/1556] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:36.981843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687796a0-0bec-4228-9e77-db10a69eed30 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.982119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687796a0-0bec-4228-9e77-db10a69eed30 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.982356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687796a0-0bec-4228-9e77-db10a69eed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.991106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12150a04-0efa-4805-8525-0172d1640ad9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:36.996296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bc766-cd6d-46be-99ee-bbad2452e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:36.996986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc766-cd6d-46be-99ee-bbad2452e009 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:36.997273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc766-cd6d-46be-99ee-bbad2452e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:36.997552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bc766-cd6d-46be-99ee-bbad2452e009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:36.998274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc766-cd6d-46be-99ee-bbad2452e009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:36.999866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bc766-cd6d-46be-99ee-bbad2452e009 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.000162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-687796a0-0bec-4228-9e77-db10a69eed30 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:37.001419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-687796a0-0bec-4228-9e77-db10a69eed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:37.009229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 770/1557] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:37.010596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.010753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 788/1558] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:37.010847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.010959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.011630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.011929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.012318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.028499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:37.029710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:37.030083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:37.031233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:37.038328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 771/1559] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:37.039091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.043533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 789/1560] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:37.043533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.048418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07c324-451a-4ab9-b80a-5bf8f06c7a2e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.051436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35a85e-55f5-4020-8b42-faf0657effbf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.053017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.053725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.053941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.054219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.054940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:37.055503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.056360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.056504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:35:37.056504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:35:37.056504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:35:37.057029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.057313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.057416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.057592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.058314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:37.058619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.060196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.069049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 772/1561] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:37.069834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.072144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 790/1562] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:37.072947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.082246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c177e8-5f83-42ac-9c48-272338547d6a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.087122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7ef32-1984-4d49-bb8a-5417fa8e99b4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.087410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.088040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.088326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.088597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.089310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.090302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:35:37.090302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:35:37.090302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:35:37.091477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.092178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.092869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.093157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.093433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.094154 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:37.094464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.096067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.107990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 773/1563] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:37.108818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.119951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6afdc-76a5-408c-aa3e-a6f854a4cbae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.124459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.125138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.125422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.125696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.126448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:37.126754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.128330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.140318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 774/1564] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:37.141132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.150498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b01e3-808c-4c7e-96ac-3e626c6e91a9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.154975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.155596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.155879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.156157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.156948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.158501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.168669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 775/1565] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:37.169436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.179094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323401d4-2f7e-40da-ad5f-cff800f5727e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.184106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.184800 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.185106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.185393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.186105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:37.186409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.187969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.199876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 776/1566] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:37.207042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.207173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 791/1567] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.207173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.213536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c280b-41e7-402f-a6a7-c54a50649cfa admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.224756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:37.250304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:37.269746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.270461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.270742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.270972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8bf3-da36-4b6b-996b-7315a280bab2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.271094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.271784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:37.272093 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.273715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.275424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.276116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.276402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.276847 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.277540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.279476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.284980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 777/1568] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:37.285833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.295586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080e1ec-b7d0-4f1a-b10d-e68d1947babd admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.300050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.300720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.301004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.301285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.301965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.303905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.376930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 792/1569] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.377660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.417071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 778/1570] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.421002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.438538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c057b-4f15-4d6e-a469-d031cfdfc706 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.481631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765f647-fb54-4b74-a2a7-96ea90e69b60 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.486494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.487199 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.487485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.487787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.488473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.490403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.494426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.499214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.499214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.499214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.499214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.499214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.600591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 779/1571] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 389 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.601437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.606086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 793/1572] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.606780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.664624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:37.666647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ca25a-8cfb-494a-93c1-7924e7bda149 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.669857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00b76f-24fc-47b2-91a1-c1b6da74725e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.673985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.673985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.673985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.673985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] PATH_INFO: `/v3/projects/38c03ebad4214ad981876f86e690b716/users/158a29a9569a42b599f949746ee79f46/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.674636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.675465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.675752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.676924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.677625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.679524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.687166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c03ebad4214ad981876f86e690b716, user_id=158a29a9569a42b599f949746ee79f46, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.689856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.692858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:37.734612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 780/1573] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:37 2022] PUT /identity/v3/projects/38c03ebad4214ad981876f86e690b716/users/158a29a9569a42b599f949746ee79f46/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:37.735376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.761955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 794/1574] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 357 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.761955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.805721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d965db9-13da-4b87-a45a-0c82e3957f2d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.823378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b6cb4-5bf9-4bdb-b9cd-29fc50b4d5ce admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:37.828199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.828885 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.829162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.829431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.830107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.832026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:37.954388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 795/1575] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/projects => generated 375 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:37.955427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:37.986106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:37.986795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:37.987193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:37.987501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:37.988192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:37.989227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:35:37.989227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:35:37.989227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:35:37.990983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.017754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862d92e-6ecf-4797-8058-89e1db3eff7c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.022500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.023156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.023434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.023705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.024383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.026369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.056456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 781/1576] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.057287 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.066555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad239c-7228-476e-889f-3516ccecfa03 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.071146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.071769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.072046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.072314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.073012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.074881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.113100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 796/1577] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:37 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.113967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.123862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e985c0a-afcf-4da8-b9f6-2a2d9b5e8765 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.128409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448f18b-956e-4339-80ca-b89659b61ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.129070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f18b-956e-4339-80ca-b89659b61ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.129347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f18b-956e-4339-80ca-b89659b61ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.129616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448f18b-956e-4339-80ca-b89659b61ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.130288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f18b-956e-4339-80ca-b89659b61ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.132252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448f18b-956e-4339-80ca-b89659b61ca2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.151916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 782/1578] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.151916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.162426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1aa25-d0f5-4eb5-8bb7-832daee0d34a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.166948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.167568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.167848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.168120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.168849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.170726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.209695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 797/1579] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.210929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.211215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.211485 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.237032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] MFA Rules not processed for user `158a29a9569a42b599f949746ee79f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:38.238202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:38.261497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 783/1580] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.262628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.267225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:38.272360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39ab77-4259-45d6-8443-9e8f3c031ac6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.277101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.277731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.278008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.278275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.278943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.280850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.306896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 798/1581] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:38.307715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.317474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17a070-f4be-4a28-9e2a-1a110236f69b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.322192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.323139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.324467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.324467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.325164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.327418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.364319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 784/1582] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.365276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.374434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7ca1d-c743-4759-b0b5-5377fd223ff8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.378914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.379564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.379842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.380118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.381400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.382964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.392498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 785/1583] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.393281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.404002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd8367-0ba7-4cbd-bc96-2ca3cb99f76c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.408525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.409204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.409487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.409764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.410477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.412052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.421881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 786/1584] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.422662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.432661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caea85-29c9-407b-9f08-785094bff906 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.437493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.438112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.438399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.438675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.440012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.441603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.445409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 799/1585] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:38.446339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.455746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 787/1586] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.455746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.457762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2319bf-28b0-4d3a-9dfb-49687f5c9639 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.463032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec941887-1fd9-49af-96d5-3b7ecf3719a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.463193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14ee9-18ad-46e0-8528-3ffe29ac7191 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.463620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941887-1fd9-49af-96d5-3b7ecf3719a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.463898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941887-1fd9-49af-96d5-3b7ecf3719a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.464168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec941887-1fd9-49af-96d5-3b7ecf3719a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.464919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec941887-1fd9-49af-96d5-3b7ecf3719a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.466547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec941887-1fd9-49af-96d5-3b7ecf3719a9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.467616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.468257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.468542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.473789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.473789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.473789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.473789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:38.476832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 800/1587] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.478069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48797b-749a-4d38-bb12-1aa20277bab3 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.478348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48797b-749a-4d38-bb12-1aa20277bab3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.478604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48797b-749a-4d38-bb12-1aa20277bab3 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.480060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 801/1588] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jun 16 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:35:38.481630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48797b-749a-4d38-bb12-1aa20277bab3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.481763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 788/1589] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.484977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.494319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48797b-749a-4d38-bb12-1aa20277bab3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.496791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9762-ddb7-42fc-b9e8-7c82590a75a4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.499028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.499551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.499781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.500010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.500113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.500283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.500400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.500685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.501032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.501402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.502693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.502993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.513347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 789/1590] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.514780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.514880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 802/1591] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.515361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.525536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081609da-12bf-496e-8506-64e3b4ad2190 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.526060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985eab4b-e0c9-4efc-afa3-f09867992463 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.530235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.530867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.531143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.531418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.531599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.532118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.532245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.532510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.532839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.533560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.533699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.535117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.544117 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 803/1592] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.544966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.549390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 790/1593] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.549390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.556019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07ec1-2183-4f22-821d-426bd006ee08 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.561034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.561693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.561943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce0afe-4d18-4fc6-aad9-fe77d0c277d2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.562089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.562240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.562963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.564538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.566513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dfd5e-c9d5-4066-b20b-b98b0c52ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.567152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfd5e-c9d5-4066-b20b-b98b0c52ee74 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.567427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfd5e-c9d5-4066-b20b-b98b0c52ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.567697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dfd5e-c9d5-4066-b20b-b98b0c52ee74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.568487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfd5e-c9d5-4066-b20b-b98b0c52ee74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.570084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dfd5e-c9d5-4066-b20b-b98b0c52ee74 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.574728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 804/1594] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.575613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.580248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 791/1595] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.581496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.581779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.582048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.586272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966e6ad-8ccd-4899-ab81-93472b58d8e7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.592968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.593675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.593988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.594266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.595034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.596623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.600337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:38.601559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:38.607063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 805/1596] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.607933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.617567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f2fa7-017f-45ad-88c1-4f979d8ebcd8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.622049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.622896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.623175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.623443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] PATH_INFO: `/v3/projects/d02fcd4ff818482fb04e9cdea481766f/users/58be610f6adc46269a46db36f41d6b25/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.638340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d02fcd4ff818482fb04e9cdea481766f, user_id=58be610f6adc46269a46db36f41d6b25, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.639473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:35:38.639473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:35:38.639473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:35:38.641439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.667332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 792/1597] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jun 16 20:35:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:38.668292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.677789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177631f-2ccf-42ab-bc60-5dc110b6be68 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.682561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.683191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.683475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.683748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.684469 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.686076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.695676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 793/1598] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.696998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.706065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33681716-8ab6-4da0-8ddb-4e513d83858a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.711180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.711813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.712089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.712360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.713152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.714652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.724242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 794/1599] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:38.725735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.735164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84553aa-d760-4f23-9f39-649053f9d27f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.741626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 806/1600] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:38 2022] PUT /identity/v3/projects/d02fcd4ff818482fb04e9cdea481766f/users/58be610f6adc46269a46db36f41d6b25/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:38.742431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.792254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.793180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.793464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.793739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] PATH_INFO: `/v3/projects/da5f09d0e6064f70af9409a608c2513b/users/63d9cb5ea09c46c6a99d4ea7dc61eb94/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.805409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc6c9-651e-492f-a399-481d0134d6ee admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.808297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=da5f09d0e6064f70af9409a608c2513b, user_id=63d9cb5ea09c46c6a99d4ea7dc61eb94, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.810331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.810996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.811222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.811491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.811762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] PATH_INFO: `/v3/projects/79ef64387ef24e6eb4f1f31a0c521f17/users/e1b1a5aa634d40709b14bd2f7355a850/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.826501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ef64387ef24e6eb4f1f31a0c521f17, user_id=e1b1a5aa634d40709b14bd2f7355a850, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.829191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.873143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 795/1601] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:38 2022] PUT /identity/v3/projects/da5f09d0e6064f70af9409a608c2513b/users/63d9cb5ea09c46c6a99d4ea7dc61eb94/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:38.873932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.890400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:38.899998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 807/1602] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:38 2022] PUT /identity/v3/projects/79ef64387ef24e6eb4f1f31a0c521f17/users/e1b1a5aa634d40709b14bd2f7355a850/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:38.901080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:38.916716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:38.934718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be4593-4996-44c0-a533-f28c91664adf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.964670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf523-fce0-4cf5-a1ad-4f1bfb05b05a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:38.969907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.970907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.971173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.971443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] PATH_INFO: `/v3/projects/de7b05ea6987431d898da3fb1f05b0e6/users/aec7846c1b414285b314d686e8c06c16/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:38.986739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7b05ea6987431d898da3fb1f05b0e6, user_id=aec7846c1b414285b314d686e8c06c16, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:38.989579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:38.991367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:38.991833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:38.992116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:38.992392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] PATH_INFO: `/v3/projects/688ce67475ff471faccdbdce847b5aa5/users/3edd15e5a774477d91c721251e61f5fd/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.006542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=688ce67475ff471faccdbdce847b5aa5, user_id=3edd15e5a774477d91c721251e61f5fd, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.009198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.067585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 808/1603] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:38 2022] PUT /identity/v3/projects/de7b05ea6987431d898da3fb1f05b0e6/users/aec7846c1b414285b314d686e8c06c16/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:39.068640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.078113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 796/1604] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:38 2022] PUT /identity/v3/projects/688ce67475ff471faccdbdce847b5aa5/users/3edd15e5a774477d91c721251e61f5fd/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:39.079056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.143092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42c923-9c9b-4ac4-9b97-515cb327d2b7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.148525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c376a-f76b-465a-9721-467361af9cae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.153415 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.154300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.154578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.154855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] PATH_INFO: `/v3/projects/a9111f6a13c8442c835d7697a4206028/users/fa2714b95ec84cfdabfd98744f5ab393/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.174509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9111f6a13c8442c835d7697a4206028, user_id=fa2714b95ec84cfdabfd98744f5ab393, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.177522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.207367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4838335-8ff5-4ff0-9c2e-c8f1fcd459cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.208012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838335-8ff5-4ff0-9c2e-c8f1fcd459cb service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.208295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838335-8ff5-4ff0-9c2e-c8f1fcd459cb service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.208569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4838335-8ff5-4ff0-9c2e-c8f1fcd459cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.239054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:39.244346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 797/1605] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:39 2022] PUT /identity/v3/projects/a9111f6a13c8442c835d7697a4206028/users/fa2714b95ec84cfdabfd98744f5ab393/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:39.245181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.267680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4838335-8ff5-4ff0-9c2e-c8f1fcd459cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.269321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4838335-8ff5-4ff0-9c2e-c8f1fcd459cb service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.277304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:39.279523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 809/1606] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:39.280902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7279d-8ead-47e6-a7e5-351082cd766a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.281191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7279d-8ead-47e6-a7e5-351082cd766a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.281469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7279d-8ead-47e6-a7e5-351082cd766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.307811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e9f7279d-8ead-47e6-a7e5-351082cd766a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.309087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e9f7279d-8ead-47e6-a7e5-351082cd766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.312208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e67698-9b3e-476a-ae61-7269d9beafa7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.314672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc2251-ea93-4369-8e4f-3931c41fa0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.315553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc2251-ea93-4369-8e4f-3931c41fa0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.315834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc2251-ea93-4369-8e4f-3931c41fa0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.316105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc2251-ea93-4369-8e4f-3931c41fa0a4 admin admin] PATH_INFO: `/v3/projects/628a4c09944b47a5a43e4c27caae9619/users/7926fb5f95ef4b6e894b7dac7f91625a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.317600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 810/1607] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.318824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee526ed9-655d-4155-922c-462e06870149 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.319176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee526ed9-655d-4155-922c-462e06870149 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.319532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee526ed9-655d-4155-922c-462e06870149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.337876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc2251-ea93-4369-8e4f-3931c41fa0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=628a4c09944b47a5a43e4c27caae9619, user_id=7926fb5f95ef4b6e894b7dac7f91625a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.340775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc2251-ea93-4369-8e4f-3931c41fa0a4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.348588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ee526ed9-655d-4155-922c-462e06870149 None None] MFA Rules not processed for user `63d9cb5ea09c46c6a99d4ea7dc61eb94`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.352356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ee526ed9-655d-4155-922c-462e06870149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.405341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 798/1608] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:39 2022] PUT /identity/v3/projects/628a4c09944b47a5a43e4c27caae9619/users/7926fb5f95ef4b6e894b7dac7f91625a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:39.407027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a313-1910-4427-ae1d-6877125b291e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.407379 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a313-1910-4427-ae1d-6877125b291e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.407722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3a313-1910-4427-ae1d-6877125b291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.416642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 811/1609] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.420265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e644a-21cf-491e-b78b-2ccbc915844d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.420265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e644a-21cf-491e-b78b-2ccbc915844d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.420265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e644a-21cf-491e-b78b-2ccbc915844d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.425684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-96b3a313-1910-4427-ae1d-6877125b291e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.426980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-96b3a313-1910-4427-ae1d-6877125b291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.439878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d26e644a-21cf-491e-b78b-2ccbc915844d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.442322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d26e644a-21cf-491e-b78b-2ccbc915844d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.494045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 799/1610] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.495342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.495628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.495913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.514660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.516169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.516301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 812/1611] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.517469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8692c-6677-4860-970b-f2806a12a0ae None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.517907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8692c-6677-4860-970b-f2806a12a0ae None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.518279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8692c-6677-4860-970b-f2806a12a0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.530165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 800/1612] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.530165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.572314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-75c8692c-6677-4860-970b-f2806a12a0ae None None] MFA Rules not processed for user `fa2714b95ec84cfdabfd98744f5ab393`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.573582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-75c8692c-6677-4860-970b-f2806a12a0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.600884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fd7c8-ed7f-4332-aae6-56564af93b40 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.606573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef36d-9956-4b7d-9337-8a803c1b7a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.607534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef36d-9956-4b7d-9337-8a803c1b7a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.607824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef36d-9956-4b7d-9337-8a803c1b7a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.608099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef36d-9956-4b7d-9337-8a803c1b7a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.622466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ef36d-9956-4b7d-9337-8a803c1b7a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.622999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:39.623949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ef36d-9956-4b7d-9337-8a803c1b7a2a service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.635176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 801/1613] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:39.636589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.636904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.637177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.649845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 813/1614] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.649845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e4bf-474b-4c9b-bdda-d068a903defd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.649845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e4bf-474b-4c9b-bdda-d068a903defd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.649845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8e4bf-474b-4c9b-bdda-d068a903defd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.649845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 814/1615] 10.222.0.65 () {54 vars in 961 bytes} [Thu Jun 16 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:35:39.650321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8e4bf-474b-4c9b-bdda-d068a903defd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.660905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.662930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.663461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8e4bf-474b-4c9b-bdda-d068a903defd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.667303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.667940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.668219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.668491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.671031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 802/1616] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.672000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.678635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.680171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.683797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2d739-b444-4652-856f-fcbd6a29acb3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.688261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e7f6-2d8c-4b85-94df-432150366ee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.688943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e7f6-2d8c-4b85-94df-432150366ee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.689223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e7f6-2d8c-4b85-94df-432150366ee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.689498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e7f6-2d8c-4b85-94df-432150366ee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.691321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 815/1617] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:39.692135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.704526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e7f6-2d8c-4b85-94df-432150366ee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.704716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741a08-7270-4faa-9a93-27601c33d363 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.704808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e7f6-2d8c-4b85-94df-432150366ee3 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.704893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede8a48-8063-4549-a5d3-b254998c25a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.705550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede8a48-8063-4549-a5d3-b254998c25a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.705901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede8a48-8063-4549-a5d3-b254998c25a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.706254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede8a48-8063-4549-a5d3-b254998c25a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.714370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 803/1618] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:39.715672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a8a2-0cc5-4090-9abc-6752738a391e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.715955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a8a2-0cc5-4090-9abc-6752738a391e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.716960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede8a48-8063-4549-a5d3-b254998c25a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.717092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a8a2-0cc5-4090-9abc-6752738a391e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.718431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 804/1619] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jun 16 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:35:39.718552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fede8a48-8063-4549-a5d3-b254998c25a9 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.721706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a8a2-0cc5-4090-9abc-6752738a391e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.729470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 816/1620] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:39.730755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.731044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.731326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.741021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a8a2-0cc5-4090-9abc-6752738a391e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.747117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e936ff-5100-4de2-ab09-692df593ac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.748018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e936ff-5100-4de2-ab09-692df593ac67 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.748300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e936ff-5100-4de2-ab09-692df593ac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.748575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e936ff-5100-4de2-ab09-692df593ac67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.749460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e936ff-5100-4de2-ab09-692df593ac67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.749840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.751783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.751909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e936ff-5100-4de2-ab09-692df593ac67 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.839744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 817/1621] 10.222.0.65 () {58 vars in 1058 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.840741 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.853098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea57e30-6828-4635-b73a-84e6e1645193 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.854870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 805/1622] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:39.857057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.857679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.858010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.873243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:39.879896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:39.881140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:39.907912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.908905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.910962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.910962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.972264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 806/1623] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:35:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:39.973722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:39.986044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71f7a6-6f1a-4125-a24f-3218b75132c2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:39.988428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:39.991064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:39.995029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:39.995769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:39.998162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:39.998162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:39.998654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:40.004339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 818/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:40.005300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.015177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117333ea-9443-4e3e-a6ff-f96a9c9d97b9 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.020075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.021402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.022857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.023175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.023843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.025841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.068144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.069890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.079618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 807/1625] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:40.080529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.120972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 819/1626] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:40 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:40.125494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.145783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d0a33-9b70-4d2d-8ea1-9e65c315a5d8 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.150388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.151037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.151321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.151600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.158691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340af5fb-a0b8-45b5-a235-84c6f5dcb5e2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.170588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.172178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.174180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.174860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.175144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.175420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.176154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.182287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.187023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 808/1627] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:40.201738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 820/1628] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:35:40.206660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.220649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026bebd-b8aa-467c-af5c-aa14d16e9d64 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.227174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd7271-1dce-410a-b483-a7ebebfbd600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.228374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7271-1dce-410a-b483-a7ebebfbd600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.228984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7271-1dce-410a-b483-a7ebebfbd600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.239236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd7271-1dce-410a-b483-a7ebebfbd600 admin admin] PATH_INFO: `/v3/projects/1160dc01516342b9beb317445104470c/users/97348e470b084386902b27e6f42bb12b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.249096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7271-1dce-410a-b483-a7ebebfbd600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1160dc01516342b9beb317445104470c, user_id=97348e470b084386902b27e6f42bb12b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.252105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd7271-1dce-410a-b483-a7ebebfbd600 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.338818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.339876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 809/1629] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:40 2022] PUT /identity/v3/projects/1160dc01516342b9beb317445104470c/users/97348e470b084386902b27e6f42bb12b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:40.348608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fb965-462a-497b-991e-80d0f29bfa18 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.348990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fb965-462a-497b-991e-80d0f29bfa18 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.349339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fb965-462a-497b-991e-80d0f29bfa18 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.352016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 810/1630] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jun 16 20:35:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:35:40.357181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.358053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.358404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.359257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f61aad-d597-473e-b7e2-5e745472e80c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.377673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:40.379872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:40.395490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:40.445706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.446718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.447287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.448021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.449360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.451262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.464289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 821/1631] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:40.468464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.490775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea680ab-00a9-4425-b560-382d14b1b350 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.496909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.497948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.498307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.498716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] PATH_INFO: `/v3/projects/1160dc01516342b9beb317445104470c/users/97348e470b084386902b27e6f42bb12b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.500891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1160dc01516342b9beb317445104470c, user_id=97348e470b084386902b27e6f42bb12b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.502864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 811/1632] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:35:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:35:40.503712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.525249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.525734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 822/1633] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:40 2022] PUT /identity/v3/projects/1160dc01516342b9beb317445104470c/users/97348e470b084386902b27e6f42bb12b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:35:40.525734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.526515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892a918-c49c-40fb-a809-71533f064f5c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.593388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b552d91-658c-41c6-a60d-21df19ea0687 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.597652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64156b4-4d07-4dfe-9068-9be8061d143b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.598306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64156b4-4d07-4dfe-9068-9be8061d143b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.598654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64156b4-4d07-4dfe-9068-9be8061d143b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.599056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64156b4-4d07-4dfe-9068-9be8061d143b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.600521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.601662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.602118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.602393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] PATH_INFO: `/v3/users/158a29a9569a42b599f949746ee79f46` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.603648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158a29a9569a42b599f949746ee79f46)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.605878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.673843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:40.676299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64156b4-4d07-4dfe-9068-9be8061d143b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.677784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64156b4-4d07-4dfe-9068-9be8061d143b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.689554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 823/1634] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:40.690914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.691514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.691514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.722954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] MFA Rules not processed for user `97348e470b084386902b27e6f42bb12b`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:40.724159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:40.808522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 824/1635] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:40.817174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:40.833844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ed364-2190-4122-b1ea-dfa39fded01e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:40.843884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d410d4-88b1-4071-8bf6-78ee4bea7c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:40.844544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d410d4-88b1-4071-8bf6-78ee4bea7c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:40.844853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d410d4-88b1-4071-8bf6-78ee4bea7c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:40.846851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d410d4-88b1-4071-8bf6-78ee4bea7c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:40.846961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158a29a9569a42b599f949746ee79f46'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:40.883302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d410d4-88b1-4071-8bf6-78ee4bea7c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:40.887011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d410d4-88b1-4071-8bf6-78ee4bea7c52 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:40.889451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158a29a9569a42b599f949746ee79f46'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:40.892724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158a29a9569a42b599f949746ee79f46'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:40.912864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158a29a9569a42b599f949746ee79f46'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:40.924775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 825/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:35:41.005668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158a29a9569a42b599f949746ee79f46'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:41.014402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 812/1637] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:35:40 2022] DELETE /identity/v3/users/158a29a9569a42b599f949746ee79f46 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:41.019464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:41.019464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:41.019700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:41.067231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:41.071248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:41.173444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 826/1638] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:41.189574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:41.191283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:41.248416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:41.249424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:41.251069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:41.311446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2514f0-e3c9-4b47-ae4e-aebf90f576a6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:41.319313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:41.320387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:41.320991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:41.321519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:41.335636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:41.338403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:41.356012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66975168-c3df-4c39-875e-2c2f6a3d1eb8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:41.356145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 813/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:41.356410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:41.357283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:41.357573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:41.357934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:41.359784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:41.392256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:41.444768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:41.446366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf31cf-d203-41c6-97ca-a5c1affefd4f service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:41.459269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 827/1640] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:35:42.427595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:42.430412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:42.447877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e443d-6583-4c0a-894c-9aecdc084e03 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:42.454005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:42.455388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:42.456586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:42.456980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] PATH_INFO: `/v3/projects/38c03ebad4214ad981876f86e690b716` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:42.458457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c03ebad4214ad981876f86e690b716)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:42.460913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: WARNING py.warnings [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:35:42.460913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: warnings.warn(msg) Jun 16 20:35:42.460913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: Jun 16 20:35:42.463074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:42.630583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c03ebad4214ad981876f86e690b716', 'request_id': 'req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:42.654584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c03ebad4214ad981876f86e690b716', 'request_id': 'req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:42.678021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c03ebad4214ad981876f86e690b716', 'request_id': 'req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:42.769227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] The token cache is being invalidate because project 38c03ebad4214ad981876f86e690b716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:35:42.769797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:42.770590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-78e0db4f-39ca-4872-8a5c-81bc7d9fc28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:42.773023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 814/1641] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:35:42 2022] DELETE /identity/v3/projects/38c03ebad4214ad981876f86e690b716 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:42.778565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:42.779078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:42.779158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:42.814736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:42.816158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:42.983930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 828/1642] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:42.992455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:42.992654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:42.993164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.015992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:43.017405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:43.033057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 815/1643] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:43.033605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.054244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447f17a-3a87-48ca-bfb8-860ba9ed11a1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:43.059871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:43.060708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.060954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.061418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.062208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:43.062521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:43.064657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:43.079599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 829/1644] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:35:43.083691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.093827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22605b43-bb20-4096-9507-7dc9630e6257 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:43.099703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:43.100467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.106516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.106516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.106516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:43.106516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:43.254169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 816/1645] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:43 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:43.254476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.265462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7710b-2181-45f2-9245-155d638c6145 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:43.333137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:43.333734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.334014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.334287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.335319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:43.337478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:43.414183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 830/1646] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:43 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:43.417956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.437931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0562ee2-a50b-4930-b179-9e8f70b38909 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:43.443393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:43.445288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.445288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.445447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.446697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:43.448582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:43.466566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 817/1647] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:43.469812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.501929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3611e1-3247-4e7f-a642-e592921b6bca admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:43.511609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b4c8e6-6bd3-4231-95dc-f2b12ad0e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:43.512228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c8e6-6bd3-4231-95dc-f2b12ad0e772 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.512228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c8e6-6bd3-4231-95dc-f2b12ad0e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.513648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b4c8e6-6bd3-4231-95dc-f2b12ad0e772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.514899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c8e6-6bd3-4231-95dc-f2b12ad0e772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:43.516983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b4c8e6-6bd3-4231-95dc-f2b12ad0e772 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:43.531781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 831/1648] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:35:43.536329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.552667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa539a2d-0861-48c9-85fd-2c3b448ef288 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:43.568503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:43.571429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.571726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.573693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] PATH_INFO: `/v3/projects/a2939e32a6b3433d9baae3ca3da15ecc/users/a39ac59960f6424289b8d45938911739/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.598904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2939e32a6b3433d9baae3ca3da15ecc, user_id=a39ac59960f6424289b8d45938911739, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:43.602102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:43.732625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 818/1649] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:43 2022] PUT /identity/v3/projects/a2939e32a6b3433d9baae3ca3da15ecc/users/a39ac59960f6424289b8d45938911739/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:43.744366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:43.744681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:43.744971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:43.790150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] MFA Rules not processed for user `a39ac59960f6424289b8d45938911739`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:43.791460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:43.816681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:43.904876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 832/1650] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:43.909517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:43.997991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:44.021515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc1afc-9bb0-43c6-8600-9074492872d8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:44.028778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:44.030243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.030726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.031156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.032667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:44.037289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:44.151575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 819/1651] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:43 2022] POST /identity/v3/projects => generated 373 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:35:44.155574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:44.170026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51899311-6b12-48ba-9f40-66d1c33de549 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:44.236025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:44.236766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.237547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.237547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.238157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:44.240463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:44.356323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 833/1652] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:44 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:44.360375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:44.378272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7a1de-847a-49ee-bd6d-f669af4c9340 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:44.391910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:44.391910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.391910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.391910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.393577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:44.395414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:44.420676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 820/1653] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:44.421853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:44.433698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeade90-6d00-47e2-a6a5-44ba2dcdf2b1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:44.440282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:44.441789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.442127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.442643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] PATH_INFO: `/v3/projects/70840b6b04ca4dd6a3549af65d22fd39/users/eceba281e66243ce9513bca226b6883d/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.461740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70840b6b04ca4dd6a3549af65d22fd39, user_id=eceba281e66243ce9513bca226b6883d, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:44.464659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:44.557834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 834/1654] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:44 2022] PUT /identity/v3/projects/70840b6b04ca4dd6a3549af65d22fd39/users/eceba281e66243ce9513bca226b6883d/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:44.561504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:44.573295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c275c-d729-4b39-ae17-286fdfcdf974 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:44.655500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7506-c922-42bc-b77b-d494f8afa9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:44.656637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7506-c922-42bc-b77b-d494f8afa9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.656945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7506-c922-42bc-b77b-d494f8afa9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.657217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7506-c922-42bc-b77b-d494f8afa9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.657958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc7506-c922-42bc-b77b-d494f8afa9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:44.660171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc7506-c922-42bc-b77b-d494f8afa9d5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:44.686507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 821/1655] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:35:44.695684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:44.716224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee18c68-6372-44cd-abd4-a8d64e8f0399 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:44.729412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:44.730414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.730796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.731143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] PATH_INFO: `/v3/projects/70840b6b04ca4dd6a3549af65d22fd39/users/eceba281e66243ce9513bca226b6883d/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.733408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=70840b6b04ca4dd6a3549af65d22fd39, user_id=eceba281e66243ce9513bca226b6883d, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:44.736535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:44.763248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 835/1656] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:44 2022] PUT /identity/v3/projects/70840b6b04ca4dd6a3549af65d22fd39/users/eceba281e66243ce9513bca226b6883d/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:44.765191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:44.765634 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:44.766133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:44.801538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] MFA Rules not processed for user `eceba281e66243ce9513bca226b6883d`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:44.802869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:44.919066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 822/1657] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:35:44.925816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:44.927832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:45.060081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d46c9-a36f-45f4-8546-898e9d7af2bf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:45.067643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:45.068587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:45.068999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:45.069562 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:45.082712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:45.086423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:45.102878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 836/1658] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:35:45.429481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:45.452639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62cbfcd-c18f-4fe9-9a6f-476bddd74496 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:45.458595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314bfe8-4d1a-40d3-9ad3-90289dc229cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:45.463818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314bfe8-4d1a-40d3-9ad3-90289dc229cc service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:45.464383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314bfe8-4d1a-40d3-9ad3-90289dc229cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:45.464878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314bfe8-4d1a-40d3-9ad3-90289dc229cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:45.652787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314bfe8-4d1a-40d3-9ad3-90289dc229cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:45.656023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314bfe8-4d1a-40d3-9ad3-90289dc229cc service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:45.685967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 823/1659] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:46.047192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:46.236740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:46.237714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:46.265043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:46.412205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75ada3-66a3-4d21-b0f0-890e86413a28 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:46.432652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:46.434681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:46.447944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:46.448540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] PATH_INFO: `/v3/users/63d9cb5ea09c46c6a99d4ea7dc61eb94` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:46.452165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d9cb5ea09c46c6a99d4ea7dc61eb94)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:46.455788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: WARNING py.warnings [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 20:35:46.455788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: warnings.warn(msg) Jun 16 20:35:46.455788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: Jun 16 20:35:46.463086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:46.782152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d9cb5ea09c46c6a99d4ea7dc61eb94'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:46.782896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d9cb5ea09c46c6a99d4ea7dc61eb94'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:46.857699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d9cb5ea09c46c6a99d4ea7dc61eb94'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:46.907569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d9cb5ea09c46c6a99d4ea7dc61eb94'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:46.913082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d9cb5ea09c46c6a99d4ea7dc61eb94'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:46.990207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 837/1660] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:35:46 2022] DELETE /identity/v3/users/63d9cb5ea09c46c6a99d4ea7dc61eb94 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:46.995405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:46.996325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:46.996856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:47.040477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:47.047837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:47.238624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 824/1661] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:47.256053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:47.258304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:47.418013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebadd3a-b797-4c3c-abc8-d66eba398b3c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:47.428905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f328f7d-3a72-458b-a44d-7d04b90aca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:47.430191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328f7d-3a72-458b-a44d-7d04b90aca79 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:47.430424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328f7d-3a72-458b-a44d-7d04b90aca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:47.430687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f328f7d-3a72-458b-a44d-7d04b90aca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:47.453297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328f7d-3a72-458b-a44d-7d04b90aca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:47.458532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f328f7d-3a72-458b-a44d-7d04b90aca79 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:47.505930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 838/1662] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:49.500823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:49.502502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:49.531523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c08303-dc2c-40a4-84d3-84ebec34bc56 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:49.568289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:49.569248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:49.569528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:49.569882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] PATH_INFO: `/v3/projects/da5f09d0e6064f70af9409a608c2513b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:49.571690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da5f09d0e6064f70af9409a608c2513b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:49.574043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:49.882060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5f09d0e6064f70af9409a608c2513b', 'request_id': 'req-0203230e-e02f-485a-a24e-389647b12de5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:49.918238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5f09d0e6064f70af9409a608c2513b', 'request_id': 'req-0203230e-e02f-485a-a24e-389647b12de5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:49.969778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5f09d0e6064f70af9409a608c2513b', 'request_id': 'req-0203230e-e02f-485a-a24e-389647b12de5'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:50.057384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] The token cache is being invalidate because project da5f09d0e6064f70af9409a608c2513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:35:50.059648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:50.060633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0203230e-e02f-485a-a24e-389647b12de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:35:50.064712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 825/1663] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:35:49 2022] DELETE /identity/v3/projects/da5f09d0e6064f70af9409a608c2513b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:50.069532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:50.071892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:50.071892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:50.142153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:50.146845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:50.299756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:50.429643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 839/1664] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:50.438065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:50.438516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:50.438968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:50.503260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:50.507260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:50.562297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 826/1665] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:50.566040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:50.583448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a043c-3f42-4d6d-b838-c2f0b1177546 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:50.597538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:50.598366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:50.600971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:50.600971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:50.600971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:35:50.600971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:50.604239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:50.628261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 840/1666] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:35:50.640920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:50.663608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d471d6-8c2e-4bbb-851f-742bed303cfe None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:50.678580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:50.679497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:50.680769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:50.681191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:50.682065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:50.685467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:50.831065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 827/1667] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:50 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:50.835509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:50.848903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39129e3c-a103-4176-8fe7-e4074a0fd599 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:50.993373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:50.994138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:50.996328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:50.996328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:50.996328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:50.997782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:51.099789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 841/1668] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:50 2022] POST /identity/v3/users => generated 305 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:51.102946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:51.119206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb01a12-9815-413f-b9e1-8463d6136cbf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:51.142353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:51.143252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:51.143609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:51.143952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:51.144797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:51.146536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:51.169580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 828/1669] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:51.171050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:51.184920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a14c3-c776-443b-beb5-2629ba7d0224 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:51.199107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e01e4-520d-42db-a083-fa7560ec3731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:51.199803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e01e4-520d-42db-a083-fa7560ec3731 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:51.200088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e01e4-520d-42db-a083-fa7560ec3731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:51.200365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e01e4-520d-42db-a083-fa7560ec3731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:51.201132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e01e4-520d-42db-a083-fa7560ec3731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:51.204691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e01e4-520d-42db-a083-fa7560ec3731 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:51.231887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:51.255146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463e7f-0758-4e60-9faf-8736c92da030 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:51.262111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 842/1670] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:51.282392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:51.283351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:51.283640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:51.283918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] PATH_INFO: `/v3/projects/9a4073edc905455dbe191b1e1a4c563f/users/175722188da84bdf9f1ac9aa5b1c70ea/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:51.330776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4073edc905455dbe191b1e1a4c563f, user_id=175722188da84bdf9f1ac9aa5b1c70ea, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:51.333399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:51.452066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 829/1671] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:51 2022] PUT /identity/v3/projects/9a4073edc905455dbe191b1e1a4c563f/users/175722188da84bdf9f1ac9aa5b1c70ea/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:51.453050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:51.453542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:51.453967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:51.513670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] MFA Rules not processed for user `175722188da84bdf9f1ac9aa5b1c70ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:51.515150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:51.725155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 843/1672] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:51.730411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:51.738380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:51.875681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be1602b-156e-421a-a8e3-36083be1c625 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:51.882546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:51.883765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:51.884052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:51.885080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:51.885863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:51.888985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:52.070421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:52.071097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 830/1673] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:35:51 2022] POST /identity/v3/projects => generated 409 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:52.118958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd30b7-4df7-44f5-8caa-323e60407994 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:52.259336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:52.260271 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:52.262413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:52.265249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:52.273908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:52.280388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:52.458103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 844/1674] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:35:52 2022] POST /identity/v3/users => generated 311 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:35:52.463982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:52.479484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822e6a8-973f-407d-8c05-cf50b04449d2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:52.491500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:52.492204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:52.493997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:52.494294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:52.495064 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:52.502370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:52.552222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 831/1675] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:52.554049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:52.583849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841e816-4ed3-47f2-b541-e3dd39a2aed4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:52.598845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:52.600153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:52.603744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:52.606370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] PATH_INFO: `/v3/projects/95c6629dda2f44d0980b646d886c3c6c/users/bf1e5a8c726f4b67906ecb6180db10da/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:52.656282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c6629dda2f44d0980b646d886c3c6c, user_id=bf1e5a8c726f4b67906ecb6180db10da, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:52.659081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:52.769456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:52.775798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 845/1676] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:52 2022] PUT /identity/v3/projects/95c6629dda2f44d0980b646d886c3c6c/users/bf1e5a8c726f4b67906ecb6180db10da/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:52.783615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:52.796985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7492fb9-6451-4f8f-bb51-f985e8d2902c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:52.935974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad30cad-9de8-433d-b2c9-3ec53cdeb9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:52.936685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30cad-9de8-433d-b2c9-3ec53cdeb9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:52.936972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30cad-9de8-433d-b2c9-3ec53cdeb9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:52.937621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad30cad-9de8-433d-b2c9-3ec53cdeb9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:52.937975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad30cad-9de8-433d-b2c9-3ec53cdeb9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:52.939588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad30cad-9de8-433d-b2c9-3ec53cdeb9f0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:52.995147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 832/1677] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:35:53.002002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:53.020666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9132-2225-4243-a105-133e7794cfb9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:53.052132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:53.053738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:53.055519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:53.057415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] PATH_INFO: `/v3/projects/95c6629dda2f44d0980b646d886c3c6c/users/bf1e5a8c726f4b67906ecb6180db10da/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:53.069015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c6629dda2f44d0980b646d886c3c6c, user_id=bf1e5a8c726f4b67906ecb6180db10da, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:53.072967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:53.130472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 846/1678] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:35:53 2022] PUT /identity/v3/projects/95c6629dda2f44d0980b646d886c3c6c/users/bf1e5a8c726f4b67906ecb6180db10da/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:35:53.143214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:53.143708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:53.144564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:53.202473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] MFA Rules not processed for user `bf1e5a8c726f4b67906ecb6180db10da`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:53.203950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:53.373660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 833/1679] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:53.382671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:53.385202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:53.532883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad895-2a91-443d-a5a7-96052d0283b8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:53.549585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5573f-24cc-44ca-a7b6-f34e789e0b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:53.561078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5573f-24cc-44ca-a7b6-f34e789e0b28 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:53.562085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5573f-24cc-44ca-a7b6-f34e789e0b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:53.562806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5573f-24cc-44ca-a7b6-f34e789e0b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:53.585299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5573f-24cc-44ca-a7b6-f34e789e0b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:53.588672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5573f-24cc-44ca-a7b6-f34e789e0b28 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:53.615288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 847/1680] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:54.391249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:54.503087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:54.505926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:54.536127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60d80e-c680-4996-beab-cb57dae937b2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:54.549848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b7f23-2172-4f12-9d5a-5d4fada21b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:54.550777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7f23-2172-4f12-9d5a-5d4fada21b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:54.551209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7f23-2172-4f12-9d5a-5d4fada21b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:54.551655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b7f23-2172-4f12-9d5a-5d4fada21b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:54.723825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b7f23-2172-4f12-9d5a-5d4fada21b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:54.729773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b7f23-2172-4f12-9d5a-5d4fada21b3e service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:54.768197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 834/1681] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:54 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:55.195928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:55.197183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:55.197183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:55.247255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] MFA Rules not processed for user `e1b1a5aa634d40709b14bd2f7355a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:55.248921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:55.406712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 848/1682] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:55.418363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b907c-7647-4fd4-8af3-7048cd0c2c18 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:55.418879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b907c-7647-4fd4-8af3-7048cd0c2c18 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:55.419087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b907c-7647-4fd4-8af3-7048cd0c2c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:55.462802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a23b907c-7647-4fd4-8af3-7048cd0c2c18 None None] MFA Rules not processed for user `e1b1a5aa634d40709b14bd2f7355a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:55.466378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a23b907c-7647-4fd4-8af3-7048cd0c2c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:55.487055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 835/1683] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:35:55.517176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:55.522597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:55.570632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:55.728471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71291a-8312-4e96-b9eb-ea6412e813b0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:55.755225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:55.755914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:55.761574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:55.761969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:55.796461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:55.800026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:55.821297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 849/1684] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:55.995550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1635-8822-4884-8279-a40e825ea258 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:55.996071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1635-8822-4884-8279-a40e825ea258 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:55.997400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c1635-8822-4884-8279-a40e825ea258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:56.095278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5f5c1635-8822-4884-8279-a40e825ea258 None None] MFA Rules not processed for user `58be610f6adc46269a46db36f41d6b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:56.096809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5f5c1635-8822-4884-8279-a40e825ea258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:56.259823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 836/1685] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:56.284759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:56.287856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:56.333865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b37db-b0cf-46b5-a29a-7b555c0672f3 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:56.359356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:56.363395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:56.365992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:56.366301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:56.397205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:56.398817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:56.493722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 850/1686] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:56.566546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e53d7f-47f0-4d42-b397-1ba474abcda9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:56.567092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e53d7f-47f0-4d42-b397-1ba474abcda9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:56.567092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e53d7f-47f0-4d42-b397-1ba474abcda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:56.691750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-45e53d7f-47f0-4d42-b397-1ba474abcda9 None None] MFA Rules not processed for user `3edd15e5a774477d91c721251e61f5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:56.693125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-45e53d7f-47f0-4d42-b397-1ba474abcda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:56.977436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 837/1687] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:56.997078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:57.015736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159d154b-cc0d-498c-adfe-77af4eda0d40 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:57.035328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649675-02de-4d4f-9313-34e058c2ff56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:57.036008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649675-02de-4d4f-9313-34e058c2ff56 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:57.036462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649675-02de-4d4f-9313-34e058c2ff56 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:57.036923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649675-02de-4d4f-9313-34e058c2ff56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:57.074099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649675-02de-4d4f-9313-34e058c2ff56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:57.075881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649675-02de-4d4f-9313-34e058c2ff56 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:57.094634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 851/1688] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:57.427416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7b7f8-b405-49b9-936b-7fa2eb8f705a None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:57.427976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7b7f8-b405-49b9-936b-7fa2eb8f705a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:57.428459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7b7f8-b405-49b9-936b-7fa2eb8f705a None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:57.430598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 838/1689] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jun 16 20:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:35:57.439391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154feae-a0b5-4fa6-9c8c-bc9cbf8f7ccb None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:57.439925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154feae-a0b5-4fa6-9c8c-bc9cbf8f7ccb None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:57.439925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154feae-a0b5-4fa6-9c8c-bc9cbf8f7ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:57.575988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8154feae-a0b5-4fa6-9c8c-bc9cbf8f7ccb None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:57.577413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8154feae-a0b5-4fa6-9c8c-bc9cbf8f7ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:57.723547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 852/1690] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:35:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:57.749392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7b7f8-b405-49b9-936b-7fa2eb8f705a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:57.751681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-89b7b7f8-b405-49b9-936b-7fa2eb8f705a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:57.777334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7b7f8-b405-49b9-936b-7fa2eb8f705a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:57.783435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:57.784260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:57.784745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:57.785176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:57.799811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:57.812957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:57.814353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:57.843822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 839/1691] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:58.042377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73451a-fc4a-4c7d-b3e6-3aedb242f26b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:58.042599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73451a-fc4a-4c7d-b3e6-3aedb242f26b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:58.042883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73451a-fc4a-4c7d-b3e6-3aedb242f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:58.140311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ff73451a-fc4a-4c7d-b3e6-3aedb242f26b None None] MFA Rules not processed for user `7926fb5f95ef4b6e894b7dac7f91625a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:58.143409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ff73451a-fc4a-4c7d-b3e6-3aedb242f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:58.360995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:35:58.376103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 853/1692] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:58.390994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:58.417795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83145a7-6f50-479f-9a1e-074b074c0f0f service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:58.432950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89cb630-66c4-46c1-b001-9c3612252eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:58.434096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb630-66c4-46c1-b001-9c3612252eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:58.435256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb630-66c4-46c1-b001-9c3612252eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:58.435546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89cb630-66c4-46c1-b001-9c3612252eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:58.457190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cb630-66c4-46c1-b001-9c3612252eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:58.460781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89cb630-66c4-46c1-b001-9c3612252eb3 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:58.490583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 840/1693] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:35:58.926435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7c10-0795-49ad-80c4-95f210fa03d3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:58.927402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7c10-0795-49ad-80c4-95f210fa03d3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:58.927829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7c10-0795-49ad-80c4-95f210fa03d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.073532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-38cf7c10-0795-49ad-80c4-95f210fa03d3 None None] MFA Rules not processed for user `aec7846c1b414285b314d686e8c06c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:59.074815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-38cf7c10-0795-49ad-80c4-95f210fa03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:59.339421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8e58-3526-4771-b5c6-162432865a0c None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:59.339930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8e58-3526-4771-b5c6-162432865a0c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:59.343563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a8e58-3526-4771-b5c6-162432865a0c None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.343563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 841/1694] 10.222.0.65 () {54 vars in 960 bytes} [Thu Jun 16 20:35:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:35:59.350383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf5e20-6776-4fe8-8b39-fa3bab57aac0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:59.350884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf5e20-6776-4fe8-8b39-fa3bab57aac0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:59.351380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf5e20-6776-4fe8-8b39-fa3bab57aac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.361470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 854/1695] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:59.363170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:59.363692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:59.364188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.391253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] MFA Rules not processed for user `aec7846c1b414285b314d686e8c06c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:59.393883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:59.397662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-cebf5e20-6776-4fe8-8b39-fa3bab57aac0 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:59.402284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cebf5e20-6776-4fe8-8b39-fa3bab57aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:59.423667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 855/1696] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:59.444144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:59.466407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db45163-10ef-4097-8eb2-631c7c90b329 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:59.486521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb80ad3-eef7-453b-8dc0-e1bc9a2cc44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:59.487196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80ad3-eef7-453b-8dc0-e1bc9a2cc44a service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:59.489083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80ad3-eef7-453b-8dc0-e1bc9a2cc44a service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:59.489537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb80ad3-eef7-453b-8dc0-e1bc9a2cc44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.519259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80ad3-eef7-453b-8dc0-e1bc9a2cc44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:59.525690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb80ad3-eef7-453b-8dc0-e1bc9a2cc44a service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:59.560470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 856/1697] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:35:59.562034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:59.565033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:59.565518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.612948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] MFA Rules not processed for user `e1b1a5aa634d40709b14bd2f7355a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:35:59.614270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:59.636551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 857/1698] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:59.715747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 842/1699] 10.222.0.65 () {58 vars in 1057 bytes} [Thu Jun 16 20:35:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:35:59.723735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:35:59.749969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa230a-fdc8-4bf7-bb5c-de4c92210140 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:35:59.769739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:35:59.770603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:35:59.771315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:35:59.771714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:35:59.787491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:35:59.826770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:35:59.833318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de1f48-001b-4fe7-be51-4ee2a1857822 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:35:59.860463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 858/1700] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:35:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:00.943396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc328d5-0a79-4d88-835d-1e23dea9ab00 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:00.945647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc328d5-0a79-4d88-835d-1e23dea9ab00 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:00.946654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc328d5-0a79-4d88-835d-1e23dea9ab00 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:00.949371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 843/1701] 10.222.0.65 () {54 vars in 912 bytes} [Thu Jun 16 20:36:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:36:00.965087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6abf4-f837-4877-a924-e20c9f0c661a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:00.966152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6abf4-f837-4877-a924-e20c9f0c661a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:00.966627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6abf4-f837-4877-a924-e20c9f0c661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:01.007461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-09a6abf4-f837-4877-a924-e20c9f0c661a None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:01.011618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-09a6abf4-f837-4877-a924-e20c9f0c661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:01.035914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 859/1702] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:36:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:01.102281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc328d5-0a79-4d88-835d-1e23dea9ab00 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:01.132145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc328d5-0a79-4d88-835d-1e23dea9ab00 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:01.164808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:01.168118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:01.170122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:01.173148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:01.190211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:01.192221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:01.214979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 844/1703] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:04.030879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20bb95-5657-4ac8-8eb7-c0ec70618ff0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:04.031820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20bb95-5657-4ac8-8eb7-c0ec70618ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:04.032295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20bb95-5657-4ac8-8eb7-c0ec70618ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:04.078408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cf20bb95-5657-4ac8-8eb7-c0ec70618ff0 None None] MFA Rules not processed for user `3edd15e5a774477d91c721251e61f5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:04.080287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cf20bb95-5657-4ac8-8eb7-c0ec70618ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:04.091207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 860/1704] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:04.262890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:04.462122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436452f1-ea7a-439d-92c0-1550f6ce8414 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:04.481928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:04.482839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:04.483117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:04.486113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] PATH_INFO: `/v3/users/175722188da84bdf9f1ac9aa5b1c70ea` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:04.487291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175722188da84bdf9f1ac9aa5b1c70ea)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:04.491897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:04.872224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175722188da84bdf9f1ac9aa5b1c70ea'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:04.917235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175722188da84bdf9f1ac9aa5b1c70ea'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:04.918896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175722188da84bdf9f1ac9aa5b1c70ea'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:04.926159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:04.950474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175722188da84bdf9f1ac9aa5b1c70ea'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:04.950671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8693b7b-f666-47e6-92a0-605a99b3aec4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:04.950906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8693b7b-f666-47e6-92a0-605a99b3aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:04.951145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8693b7b-f666-47e6-92a0-605a99b3aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:04.984793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e8693b7b-f666-47e6-92a0-605a99b3aec4 None None] MFA Rules not processed for user `58be610f6adc46269a46db36f41d6b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:04.986486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e8693b7b-f666-47e6-92a0-605a99b3aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:04.995792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 861/1705] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:05.036438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-1842d612-4bf5-4383-b8a2-75ba5b15ba19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175722188da84bdf9f1ac9aa5b1c70ea'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:05.044363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 845/1706] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:04 2022] DELETE /identity/v3/users/175722188da84bdf9f1ac9aa5b1c70ea => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:05.059821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:05.059821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:05.059821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:05.078086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:05.079445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:05.169815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:05.169815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:05.170073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:05.223135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:05.224382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:05.228848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 862/1707] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:05.238820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:05.241374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:05.315067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:05.355642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 846/1708] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:36:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:05.381744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead36289-5c51-456d-b139-d6862bd73f3b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:05.387901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:05.388937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:05.390470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:05.390470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:05.403221 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:05.404956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:05.418469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 863/1709] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:06.040007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:06.042796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:06.232794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd9ba9-498c-48ad-a682-d52a42fdb785 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:06.253750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:06.255364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:06.256106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:06.263050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:06.271963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:06.277519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:06.299483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 847/1710] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:36:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:36:06.441048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:06.443149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:06.486237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e0ea-99a3-41ed-8c6c-270c728b1bd7 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:06.543062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:06.547365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:06.551011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:06.554175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] PATH_INFO: `/v3/projects/9a4073edc905455dbe191b1e1a4c563f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:06.562400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4073edc905455dbe191b1e1a4c563f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:06.572024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:06.935530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4073edc905455dbe191b1e1a4c563f', 'request_id': 'req-24f8b8bf-e208-4807-8849-b06e3d4ccb88'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:06.966125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4073edc905455dbe191b1e1a4c563f', 'request_id': 'req-24f8b8bf-e208-4807-8849-b06e3d4ccb88'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.063060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4073edc905455dbe191b1e1a4c563f', 'request_id': 'req-24f8b8bf-e208-4807-8849-b06e3d4ccb88'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.090901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] The token cache is being invalidate because project 9a4073edc905455dbe191b1e1a4c563f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:07.095037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.098080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.109163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 864/1711] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:06 2022] DELETE /identity/v3/projects/9a4073edc905455dbe191b1e1a4c563f => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:07.109577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:07.149010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238d077-5676-412f-8838-aa0766f7c2f2 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:07.381453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:07.382541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:07.383391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:07.385978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] PATH_INFO: `/v3/users/bf1e5a8c726f4b67906ecb6180db10da` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:07.389449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1e5a8c726f4b67906ecb6180db10da)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:07.395700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:07.468938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:07.729738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1e5a8c726f4b67906ecb6180db10da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.798321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1e5a8c726f4b67906ecb6180db10da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.803923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1e5a8c726f4b67906ecb6180db10da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.829836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1e5a8c726f4b67906ecb6180db10da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.930383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3abb3463-344a-4f0a-80f3-c4f92061f3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1e5a8c726f4b67906ecb6180db10da'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:07.939117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 848/1712] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:07 2022] DELETE /identity/v3/users/bf1e5a8c726f4b67906ecb6180db10da => generated 0 bytes in 829 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:08.109413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:08.110267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:08.112353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e62c3-76fe-4657-9b19-6c6930f7b927 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:08.112840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e62c3-76fe-4657-9b19-6c6930f7b927 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:08.113128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e62c3-76fe-4657-9b19-6c6930f7b927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:08.149010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d00e62c3-76fe-4657-9b19-6c6930f7b927 None None] MFA Rules not processed for user `7926fb5f95ef4b6e894b7dac7f91625a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:08.150365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d00e62c3-76fe-4657-9b19-6c6930f7b927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:08.150700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8b8bf-e208-4807-8849-b06e3d4ccb88 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:08.496431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 849/1713] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:08.499055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:08.499055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:08.499055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:08.499055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] PATH_INFO: `/v3/users/fa2714b95ec84cfdabfd98744f5ab393` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:08.500156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2714b95ec84cfdabfd98744f5ab393)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:08.500156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:09.008909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2714b95ec84cfdabfd98744f5ab393'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:09.010578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2714b95ec84cfdabfd98744f5ab393'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:09.090292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2714b95ec84cfdabfd98744f5ab393'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:09.096870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:09.100899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2714b95ec84cfdabfd98744f5ab393'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:09.101976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2714b95ec84cfdabfd98744f5ab393'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:09.168284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 865/1714] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:08 2022] DELETE /identity/v3/users/fa2714b95ec84cfdabfd98744f5ab393 => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:09.173523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed603-2f58-4d02-b247-f564e1d87a12 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:09.174473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed603-2f58-4d02-b247-f564e1d87a12 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:09.175032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed603-2f58-4d02-b247-f564e1d87a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:09.233510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9f0ed603-2f58-4d02-b247-f564e1d87a12 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:09.233510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9f0ed603-2f58-4d02-b247-f564e1d87a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:09.500901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 850/1715] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:09.509464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:09.510962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:09.777688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58015d-9eff-4cf0-8939-dc5361de2512 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:09.794494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:09.795643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:09.801893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:09.801893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:09.838758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:09.843769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:09.893316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:09.902162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:09.902162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:09.906192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 866/1716] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:09.948420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:09.948520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:09.986511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 851/1717] 10.222.0.71 () {58 vars in 1015 bytes} [Thu Jun 16 20:36:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:10.057237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:10.059556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:10.098798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932846b3-f48f-4dc5-a930-7e9d169726b3 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:10.119398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23fbcc-cc48-4889-929a-de71fe0a57e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:10.120111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23fbcc-cc48-4889-929a-de71fe0a57e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:10.120895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23fbcc-cc48-4889-929a-de71fe0a57e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:10.127478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23fbcc-cc48-4889-929a-de71fe0a57e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:10.163404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23fbcc-cc48-4889-929a-de71fe0a57e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:10.168447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c23fbcc-cc48-4889-929a-de71fe0a57e9 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:10.196433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 867/1718] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:10.275146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:10.283965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:10.349581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b19f6-163d-4892-ad3b-7bd389114074 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:10.370151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:10.379902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:10.380311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:10.381008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] PATH_INFO: `/v3/projects/95c6629dda2f44d0980b646d886c3c6c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:10.392786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c6629dda2f44d0980b646d886c3c6c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:10.401438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:10.598248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:10.621959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c6629dda2f44d0980b646d886c3c6c', 'request_id': 'req-d7417107-3909-43dd-b404-2cc223cffa5e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:10.635108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c6629dda2f44d0980b646d886c3c6c', 'request_id': 'req-d7417107-3909-43dd-b404-2cc223cffa5e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:10.682417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c6629dda2f44d0980b646d886c3c6c', 'request_id': 'req-d7417107-3909-43dd-b404-2cc223cffa5e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:10.892568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] The token cache is being invalidate because project 95c6629dda2f44d0980b646d886c3c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:10.893058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:10.894752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7417107-3909-43dd-b404-2cc223cffa5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:10.898400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 852/1719] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:10 2022] DELETE /identity/v3/projects/95c6629dda2f44d0980b646d886c3c6c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:10.904684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:10.904956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:10.905247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:10.969306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:10.972292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:11.197967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 868/1720] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:11.207123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:11.207431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:11.207711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:11.234910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:11.237366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:11.269344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:11.278805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 853/1721] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:11.286029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0d453-47be-4e75-b4d7-a4bda45eb2d6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:11.301422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:11.304088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:11.305917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:11.311233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:11.311233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:11.311233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:11.311233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:11.365147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:11.381212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fa362-d015-42c3-9104-61c8dd0e3650 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:11.381964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 869/1722] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:36:11.398744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:11.399389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:11.399674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:11.399950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:11.400801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:11.403695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:11.536812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 854/1723] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:11 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:11.539167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:11.569478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c41c-8ae0-47a2-a334-03c20a96e8b0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:11.818008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:11.842809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:11.845772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:11.847359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:11.848258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:11.851134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:11.860915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:12.010836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 870/1724] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:11 2022] POST /identity/v3/users => generated 291 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:12.014991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:12.050410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744b5af-a38d-4a99-b108-62ebe0af2bae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:12.072348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:12.072348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.072348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.072348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.072809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:12.072880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:12.072961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:12.073038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:12.093553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4107512-3c7c-4b72-8b7a-792bff623511 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:12.094819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 855/1725] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:12.099943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:12.101461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:12.102362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.104594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.105674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] PATH_INFO: `/v3/projects/a9111f6a13c8442c835d7697a4206028` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.107676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9111f6a13c8442c835d7697a4206028)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:12.111393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:12.150906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ebf72-5cef-40e3-bda5-ac0f93d1e027 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:12.164446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:12.173055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.175779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.175779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.175779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:12.189667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:12.203087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 856/1726] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:12.208285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:12.236370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4402c-6747-4640-8859-5cd16df0742e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:12.246685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920aa1cc-ea09-4481-9678-808c3f2192c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:12.253585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aa1cc-ea09-4481-9678-808c3f2192c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.257424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aa1cc-ea09-4481-9678-808c3f2192c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.260383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920aa1cc-ea09-4481-9678-808c3f2192c5 admin admin] PATH_INFO: `/v3/projects/d12c25b88feb499f9cc170b5a707151e/users/1df27df7ba0b4c4b9053dadc68155c5a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.316541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aa1cc-ea09-4481-9678-808c3f2192c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12c25b88feb499f9cc170b5a707151e, user_id=1df27df7ba0b4c4b9053dadc68155c5a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:12.320603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920aa1cc-ea09-4481-9678-808c3f2192c5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:12.364930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9111f6a13c8442c835d7697a4206028', 'request_id': 'req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:12.393114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9111f6a13c8442c835d7697a4206028', 'request_id': 'req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:12.407506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 857/1727] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:12 2022] PUT /identity/v3/projects/d12c25b88feb499f9cc170b5a707151e/users/1df27df7ba0b4c4b9053dadc68155c5a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:12.422870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.422870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.422870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.474660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] MFA Rules not processed for user `1df27df7ba0b4c4b9053dadc68155c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:12.478733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:12.490730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9111f6a13c8442c835d7697a4206028', 'request_id': 'req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:12.510287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] The token cache is being invalidate because project a9111f6a13c8442c835d7697a4206028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:12.510901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:12.511891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:12.520182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 871/1728] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:12 2022] DELETE /identity/v3/projects/a9111f6a13c8442c835d7697a4206028 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:12.524141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:12.525601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:12.669897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 858/1729] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:12.674807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:12.677059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:12.726704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfabf35-c6ff-44bc-99ee-dc22c45d80f7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:12.877986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c4b8-bffa-4ea4-bcbc-b3708282a7e4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:12.891240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:12.892686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.892686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.892686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.893200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:12.895434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:12.909593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:12.910657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:12.915442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:12.915846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] PATH_INFO: `/v3/users/97348e470b084386902b27e6f42bb12b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:12.932528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97348e470b084386902b27e6f42bb12b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:12.936211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:13.088712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 859/1730] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:12 2022] POST /identity/v3/projects => generated 383 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:13.100215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:13.257998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:13.312933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97348e470b084386902b27e6f42bb12b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:13.314400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97348e470b084386902b27e6f42bb12b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:13.324662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2fe03-c112-4bf9-bf1d-a116e919fbe6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:13.332512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:13.333511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:13.333863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:13.334462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:13.335608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:13.337859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:13.414903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97348e470b084386902b27e6f42bb12b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:13.425736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97348e470b084386902b27e6f42bb12b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:13.426589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97348e470b084386902b27e6f42bb12b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:13.455629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 860/1731] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:13 2022] POST /identity/v3/users => generated 298 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:13.457003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:13.459621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:13.501059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 872/1732] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:12 2022] DELETE /identity/v3/users/97348e470b084386902b27e6f42bb12b => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:13.513959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa61e28-b01d-4b38-8e13-d44cc653faec admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:13.773519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:13.774292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:13.774592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:13.774868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:13.776906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:13.786918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:13.832714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:13.839413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 861/1733] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:13.857347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5316a10-438d-4e3c-9ad8-afccdafecfc9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:13.873982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:13.877264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:13.877561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:13.877852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] PATH_INFO: `/v3/projects/6f079eef60e74074a4736cc86a999bdb/users/a239a3dbf34c48efa3f06f659ff81f2b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:13.889916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:13.924184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f079eef60e74074a4736cc86a999bdb, user_id=a239a3dbf34c48efa3f06f659ff81f2b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:13.930873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:14.076060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 873/1734] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:13 2022] PUT /identity/v3/projects/6f079eef60e74074a4736cc86a999bdb/users/a239a3dbf34c48efa3f06f659ff81f2b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:14.080010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:14.094367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da13ac-bad9-49bf-92f8-04d7d02f0d9e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:14.282885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336deae-2906-4160-b6ff-37889cb8e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:14.282885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336deae-2906-4160-b6ff-37889cb8e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:14.282885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336deae-2906-4160-b6ff-37889cb8e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:14.282885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336deae-2906-4160-b6ff-37889cb8e4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:14.283181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336deae-2906-4160-b6ff-37889cb8e4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:14.283181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336deae-2906-4160-b6ff-37889cb8e4cf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:14.300566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 862/1735] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:14.305613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:14.331486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35a61-f1ff-44eb-9e62-41374f6c35fe admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:14.336770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:14.337932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:14.338489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:14.338929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] PATH_INFO: `/v3/projects/6f079eef60e74074a4736cc86a999bdb/users/a239a3dbf34c48efa3f06f659ff81f2b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:14.347262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f079eef60e74074a4736cc86a999bdb, user_id=a239a3dbf34c48efa3f06f659ff81f2b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:14.350226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:14.381436 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 874/1736] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:14 2022] PUT /identity/v3/projects/6f079eef60e74074a4736cc86a999bdb/users/a239a3dbf34c48efa3f06f659ff81f2b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:14.392417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:14.393115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:14.393403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:14.473015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] MFA Rules not processed for user `a239a3dbf34c48efa3f06f659ff81f2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:14.477506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:14.827418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 863/1737] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:14.837269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:14.843421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:14.976075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decdd9b-9a3b-4ae4-8e9a-826792101fb9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:14.987548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc98c8-6f1d-463c-b847-9c8b407cdca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:14.988510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc98c8-6f1d-463c-b847-9c8b407cdca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:14.988963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc98c8-6f1d-463c-b847-9c8b407cdca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:14.989388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc98c8-6f1d-463c-b847-9c8b407cdca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:15.012761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc98c8-6f1d-463c-b847-9c8b407cdca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:15.017097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fc98c8-6f1d-463c-b847-9c8b407cdca0 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:15.063678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 875/1738] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:15.262257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:15.283303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d839949-4360-4cae-a4ee-7dd45e4dd3b4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:15.302320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:15.303531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:15.306513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:15.306810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:15.323109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:15.576937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:15.592846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:15.592846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc5462-616d-412f-a6d5-5b53b640d1f9 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:15.630377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 864/1739] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:15.862774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b219-e1b5-421a-a235-6b66171192d4 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:15.862774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b219-e1b5-421a-a235-6b66171192d4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:15.862774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100b219-e1b5-421a-a235-6b66171192d4 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:15.862774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 876/1740] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:36:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:36:16.025836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:16.026135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:16.026540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:16.109999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:16.114685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:16.429874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 865/1741] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:36:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:16.491441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:16.629998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100b219-e1b5-421a-a235-6b66171192d4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:16.632432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f100b219-e1b5-421a-a235-6b66171192d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:16.830521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:16.874263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:16.901097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100b219-e1b5-421a-a235-6b66171192d4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:16.922577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:16.923682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:16.924165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:16.924591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] PATH_INFO: `/v3/projects/1160dc01516342b9beb317445104470c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:16.935676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1160dc01516342b9beb317445104470c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:16.939567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:16.948966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac315e3b-f909-4b2b-b12c-413d8185915a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:16.969781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:16.971493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:16.971783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:16.972062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] PATH_INFO: `/v3/users/1df27df7ba0b4c4b9053dadc68155c5a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:16.973630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df27df7ba0b4c4b9053dadc68155c5a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:16.976113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:17.204584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1160dc01516342b9beb317445104470c', 'request_id': 'req-144d01df-6a5d-4ab2-9987-1e64e77b682f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.217203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1160dc01516342b9beb317445104470c', 'request_id': 'req-144d01df-6a5d-4ab2-9987-1e64e77b682f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.298797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1160dc01516342b9beb317445104470c', 'request_id': 'req-144d01df-6a5d-4ab2-9987-1e64e77b682f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.342304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] The token cache is being invalidate because project 1160dc01516342b9beb317445104470c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:17.342963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.344889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.351906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 877/1742] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:16 2022] DELETE /identity/v3/projects/1160dc01516342b9beb317445104470c => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:17.353141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df27df7ba0b4c4b9053dadc68155c5a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.360250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:17.363134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:17.416412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df27df7ba0b4c4b9053dadc68155c5a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.420298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df27df7ba0b4c4b9053dadc68155c5a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.456510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df27df7ba0b4c4b9053dadc68155c5a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.537907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e5795aa5-8976-45ce-9780-bc6891d1dc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df27df7ba0b4c4b9053dadc68155c5a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:17.573228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 866/1743] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:16 2022] DELETE /identity/v3/users/1df27df7ba0b4c4b9053dadc68155c5a => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:17.573228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfa7a2-ee34-410b-85e6-e9c7cac37f7c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:17.573228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfa7a2-ee34-410b-85e6-e9c7cac37f7c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:17.573898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfa7a2-ee34-410b-85e6-e9c7cac37f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:17.607055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2abfa7a2-ee34-410b-85e6-e9c7cac37f7c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:17.608698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2abfa7a2-ee34-410b-85e6-e9c7cac37f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:17.648168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d01df-6a5d-4ab2-9987-1e64e77b682f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:17.772687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 867/1744] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:17.772687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37dc7-3ddf-43be-9cac-d3dd93f02eb2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:17.772687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37dc7-3ddf-43be-9cac-d3dd93f02eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:17.772687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a37dc7-3ddf-43be-9cac-d3dd93f02eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:17.832100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-86a37dc7-3ddf-43be-9cac-d3dd93f02eb2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:17.833366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-86a37dc7-3ddf-43be-9cac-d3dd93f02eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:17.835774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:17.837096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:17.837602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:17.838025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:17.842799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:17.867254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 868/1745] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:17.871915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:17.872203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:17.872485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:17.893184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:17.893184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:17.933491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 878/1746] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:17.934848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:17.936171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:17.978363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 869/1747] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:17.983685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.000020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed9f06-218a-4c00-9b39-53b7060ab904 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.025328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.026012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.026515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.026971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.028190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:18.028744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.035035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.082980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.083592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 879/1748] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:18.091641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:18.104091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a22fe-ee1d-4574-94e8-a20144bbdb8f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.109877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.113392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:18.128037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.129666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.129952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.132564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.133373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.141136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.271735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb6ab-1772-497c-ac3e-5a93187fc131 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.284468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.285675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.286192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.286682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.289884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 870/1749] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:18 2022] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:18.291496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.314138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.322809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.361261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 880/1750] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:18.457283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab968a6-5f5b-4c1e-840b-6ba7763a4f67 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.469221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.480218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.480885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.481793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.482909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.491271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.595661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 871/1751] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:18 2022] POST /identity/v3/users => generated 289 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:18.596137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.614517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de6f7-0dce-4e6f-9e9e-3562f675f12c service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.629325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.631393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.631928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.632858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.634742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.647988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.675593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 881/1752] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:18.680746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.709650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd72c5-104a-475f-88f6-686395d1b280 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.716781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34d6ce-739c-4a56-bf45-aa4fb7ac3775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.718671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34d6ce-739c-4a56-bf45-aa4fb7ac3775 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.718857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34d6ce-739c-4a56-bf45-aa4fb7ac3775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.719002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34d6ce-739c-4a56-bf45-aa4fb7ac3775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.719915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34d6ce-739c-4a56-bf45-aa4fb7ac3775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.721408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34d6ce-739c-4a56-bf45-aa4fb7ac3775 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.755427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 872/1753] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:18.759494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:18.773999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625df2fd-90cd-41dc-93fc-e4ad515939b6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:18.788500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:18.790394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.792307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.792849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] PATH_INFO: `/v3/projects/488cce6db76949c99379a533279b21f9/users/ecfc5f92d5df44799abdcc42d65cc9be/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:18.839838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=488cce6db76949c99379a533279b21f9, user_id=ecfc5f92d5df44799abdcc42d65cc9be, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:18.845085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:18.943131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 882/1754] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:18 2022] PUT /identity/v3/projects/488cce6db76949c99379a533279b21f9/users/ecfc5f92d5df44799abdcc42d65cc9be/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:18.955376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:18.956350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:18.956891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:19.010345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:19.018859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] MFA Rules not processed for user `ecfc5f92d5df44799abdcc42d65cc9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:19.020336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:19.135077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 873/1755] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:19.138755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:19.284509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dad999-575b-4e18-913d-95c20bb9f19d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:19.303417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:19.307765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:19.307765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:19.307765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:19.307765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:19.308123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:19.523198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 883/1756] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:19 2022] POST /identity/v3/projects => generated 375 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:19.525812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:19.553869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5182df-228b-4bd9-bb83-4b9f462f5d24 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:19.694517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:19.694751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:19.695095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:19.695388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:19.696390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:19.698625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:19.769575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:19.771653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:19.786644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dca7d-78d2-499d-ba2d-b847520375c7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:19.793860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:19.795300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:19.795610 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:19.796348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] PATH_INFO: `/v3/projects/d12c25b88feb499f9cc170b5a707151e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:19.805044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12c25b88feb499f9cc170b5a707151e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:19.805044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:19.805337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 874/1757] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:19 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:19.806824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:19.827866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4592b-48be-4cd6-a9ba-b5c44d89ac13 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:19.837656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:19.859973 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:19.860456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:19.864564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:19.864564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:19.869763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:19.886783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 875/1758] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:19.888241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:19.900334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ff5a0-e284-44f9-aa75-f92734707f25 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:19.917504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:19.919643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:19.921198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:19.921198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] PATH_INFO: `/v3/projects/fdbc6b4a37284fbd88542363aead49ca/users/fe89ecf298e74137a2091a032737e9c2/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:19.939332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbc6b4a37284fbd88542363aead49ca, user_id=fe89ecf298e74137a2091a032737e9c2, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:19.944356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:19.975043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12c25b88feb499f9cc170b5a707151e', 'request_id': 'req-ad6d3406-b03d-43c0-b472-34fa23bdf68a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:19.992608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12c25b88feb499f9cc170b5a707151e', 'request_id': 'req-ad6d3406-b03d-43c0-b472-34fa23bdf68a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.068771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 876/1759] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:19 2022] PUT /identity/v3/projects/fdbc6b4a37284fbd88542363aead49ca/users/fe89ecf298e74137a2091a032737e9c2/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:20.073274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:20.104973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12c25b88feb499f9cc170b5a707151e', 'request_id': 'req-ad6d3406-b03d-43c0-b472-34fa23bdf68a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.125236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] The token cache is being invalidate because project d12c25b88feb499f9cc170b5a707151e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:20.127749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.132453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.141223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 884/1760] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:19 2022] DELETE /identity/v3/projects/d12c25b88feb499f9cc170b5a707151e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:20.143822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:20.149477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:20.273888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286e60d-0128-4fef-9f48-b5cea0a076b0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:20.287237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa45d3-3597-4b46-9d19-8ef8d57c290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:20.288052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa45d3-3597-4b46-9d19-8ef8d57c290e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:20.288421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa45d3-3597-4b46-9d19-8ef8d57c290e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:20.289273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa45d3-3597-4b46-9d19-8ef8d57c290e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:20.290781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa45d3-3597-4b46-9d19-8ef8d57c290e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:20.292875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa45d3-3597-4b46-9d19-8ef8d57c290e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:20.298994 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3406-b03d-43c0-b472-34fa23bdf68a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:20.314946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:20.315947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:20.316306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:20.316705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] PATH_INFO: `/v3/users/a239a3dbf34c48efa3f06f659ff81f2b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:20.318341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a239a3dbf34c48efa3f06f659ff81f2b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:20.319201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 877/1761] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:20.322290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34154c-963a-4213-a64a-03bbb108dbaa None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:20.323114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:20.323464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34154c-963a-4213-a64a-03bbb108dbaa None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:20.323816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34154c-963a-4213-a64a-03bbb108dbaa None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:20.327924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 878/1762] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:36:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:36:20.328833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34154c-963a-4213-a64a-03bbb108dbaa None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:20.332544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2e34154c-963a-4213-a64a-03bbb108dbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:20.434831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34154c-963a-4213-a64a-03bbb108dbaa None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:20.460275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7304b49c-3932-421b-a5c9-e1d5c498cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:20.461221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304b49c-3932-421b-a5c9-e1d5c498cf73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:20.461504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304b49c-3932-421b-a5c9-e1d5c498cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:20.461777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7304b49c-3932-421b-a5c9-e1d5c498cf73 admin admin] PATH_INFO: `/v3/projects/fdbc6b4a37284fbd88542363aead49ca/users/fe89ecf298e74137a2091a032737e9c2/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:20.463853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304b49c-3932-421b-a5c9-e1d5c498cf73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbc6b4a37284fbd88542363aead49ca, user_id=fe89ecf298e74137a2091a032737e9c2, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:20.468372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7304b49c-3932-421b-a5c9-e1d5c498cf73 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:20.494718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 879/1763] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:20 2022] PUT /identity/v3/projects/fdbc6b4a37284fbd88542363aead49ca/users/fe89ecf298e74137a2091a032737e9c2/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:20.495962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc688-31ab-4005-9034-0488cf61191c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:20.496237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc688-31ab-4005-9034-0488cf61191c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:20.496514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9fc688-31ab-4005-9034-0488cf61191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:20.515417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:20.549460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fd9fc688-31ab-4005-9034-0488cf61191c None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:20.550722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fd9fc688-31ab-4005-9034-0488cf61191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:20.613887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a239a3dbf34c48efa3f06f659ff81f2b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.627727 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a239a3dbf34c48efa3f06f659ff81f2b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.658806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 880/1764] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:20.661592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:20.662356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:20.662638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:20.728774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] MFA Rules not processed for user `fe89ecf298e74137a2091a032737e9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:20.730620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:20.730742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a239a3dbf34c48efa3f06f659ff81f2b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.755426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a239a3dbf34c48efa3f06f659ff81f2b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.758257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a239a3dbf34c48efa3f06f659ff81f2b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:20.798683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 885/1765] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:20 2022] DELETE /identity/v3/users/a239a3dbf34c48efa3f06f659ff81f2b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:20.894456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 881/1766] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:20.905850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:20.920021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:21.039418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09bf3b-189b-493e-a4f2-8c14827b3136 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:21.050709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:21.051962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:21.052461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:21.064237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:21.066472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:21.133216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:21.134871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:21.173887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ae0a7-bda3-460f-897d-2042a673c6ac None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:21.261239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:21.266245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:21.268552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:21.279575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:21.280748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:21.281291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:21.281766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:21.285876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:21.296257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 886/1767] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:21.309843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:21.311909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc6427-afec-4937-bc6e-8c90366e254c service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:21.325378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 882/1768] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:21.518700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:21.519736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:21.625070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31159530-b0db-4c9b-8927-e1b9e6493439 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:21.646528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:21.648656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:21.648656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:21.653804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] PATH_INFO: `/v3/projects/6f079eef60e74074a4736cc86a999bdb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:21.653804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f079eef60e74074a4736cc86a999bdb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:21.654392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:22.199758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f079eef60e74074a4736cc86a999bdb', 'request_id': 'req-e152519b-68e0-451f-99ef-d5e9b8b99ea5'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:22.219605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f079eef60e74074a4736cc86a999bdb', 'request_id': 'req-e152519b-68e0-451f-99ef-d5e9b8b99ea5'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:22.273228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:22.308530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f079eef60e74074a4736cc86a999bdb', 'request_id': 'req-e152519b-68e0-451f-99ef-d5e9b8b99ea5'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:22.324367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] The token cache is being invalidate because project 6f079eef60e74074a4736cc86a999bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:22.324855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:22.326111 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e152519b-68e0-451f-99ef-d5e9b8b99ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:22.327797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 887/1769] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:21 2022] DELETE /identity/v3/projects/6f079eef60e74074a4736cc86a999bdb => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:22.332743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.333034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.333310 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.353620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:22.359242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:22.422411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 883/1770] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:22.430497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.430864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.431221 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.454739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:22.456751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:22.473938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 888/1771] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:22.479067 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:22.494749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67c19a-d5fd-4ea8-a251-8f995a7608fa None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:22.500726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:22.502398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.502398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.502398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.503862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:22.504329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:22.506900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:22.524807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 884/1772] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:22.531023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:22.550896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ef903-8ba9-4b9d-ac12-2975eb07dfc9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:22.571993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:22.573239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.573702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.574132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.575030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:22.578140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:22.721863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 889/1773] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:22 2022] POST /identity/v3/projects => generated 383 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:22.725823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:22.737783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bf6c5-80b9-4c88-abac-8f80c407ceb4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:22.803588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:22.804211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.804504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.804818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.805535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:22.807536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:22.931844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 885/1774] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:22 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:22.936410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:22.947308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338fefc-1418-4fb5-84ad-54e7e4cf2738 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:22.952226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:22.953013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.953260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.953544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.954284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:22.955882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:22.970088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 890/1775] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:22.971356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:22.985523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61823ac-fd61-45e2-a901-743f6cbd31bb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:22.991203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242874a4-9999-48d8-93d8-7b294b3fc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:22.991872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242874a4-9999-48d8-93d8-7b294b3fc6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:22.993569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242874a4-9999-48d8-93d8-7b294b3fc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:22.993569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242874a4-9999-48d8-93d8-7b294b3fc6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:22.993569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242874a4-9999-48d8-93d8-7b294b3fc6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:22.994835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242874a4-9999-48d8-93d8-7b294b3fc6fd admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:23.008537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 886/1776] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:23.009869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:23.020464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faad839-11ee-4393-ace9-9bc663b8819e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:23.025206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:23.026117 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:23.026399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:23.026671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] PATH_INFO: `/v3/projects/af000b56671c4708a69ed1d62af12989/users/50a6b08173234824a60337e27e2813bd/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:23.043206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af000b56671c4708a69ed1d62af12989, user_id=50a6b08173234824a60337e27e2813bd, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:23.045973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:23.158643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 891/1777] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:23 2022] PUT /identity/v3/projects/af000b56671c4708a69ed1d62af12989/users/50a6b08173234824a60337e27e2813bd/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:23.169514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:23.169806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:23.170084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:23.198318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] MFA Rules not processed for user `50a6b08173234824a60337e27e2813bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:23.199571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:23.301712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 887/1778] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:23.303045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:23.433062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8609-91fe-490d-a219-287bbca0248a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:23.442630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:23.443314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:23.443880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:23.443987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:23.444662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:23.446690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:23.538335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 892/1779] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:23 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:23.545967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:23.558186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ca2ca-817e-4490-9a8d-50286c78b32c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:23.637813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:23.638508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:23.638849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:23.639128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:23.640048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:23.642394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:23.762095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 888/1780] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:23 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:23.764029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:23.774991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c44fc8-47d0-499e-babf-798e12292574 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:23.779622 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:23.780967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:23.780967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:23.780967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:23.781710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:23.783312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:23.795007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 893/1781] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:23.799506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:23.820520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ec702-5507-438b-a643-d08df1335cc7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:23.827645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:23.827977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:23.828264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:23.828538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] PATH_INFO: `/v3/projects/33f2118e77114888b83b37f715578386/users/17c2b2371137433bac46c028b5183672/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:23.845223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f2118e77114888b83b37f715578386, user_id=17c2b2371137433bac46c028b5183672, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:23.847895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:23.946001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 889/1782] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:23 2022] PUT /identity/v3/projects/33f2118e77114888b83b37f715578386/users/17c2b2371137433bac46c028b5183672/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:23.950826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:23.962751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4aa9fd-3abd-4efd-b7fe-6798a99795ee admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:24.023489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb0fa9-50c3-4cff-9af8-9edab9b2bf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:24.025644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb0fa9-50c3-4cff-9af8-9edab9b2bf49 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:24.026153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb0fa9-50c3-4cff-9af8-9edab9b2bf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:24.026568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb0fa9-50c3-4cff-9af8-9edab9b2bf49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:24.027380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb0fa9-50c3-4cff-9af8-9edab9b2bf49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:24.029763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb0fa9-50c3-4cff-9af8-9edab9b2bf49 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:24.041883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 894/1783] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:24.046230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:24.056718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d7bf0-8f54-4434-9b10-0c5181682d61 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:24.062050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:24.062338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:24.062624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:24.062898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] PATH_INFO: `/v3/projects/33f2118e77114888b83b37f715578386/users/17c2b2371137433bac46c028b5183672/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:24.065183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f2118e77114888b83b37f715578386, user_id=17c2b2371137433bac46c028b5183672, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:24.067845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:24.079621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 890/1784] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:24 2022] PUT /identity/v3/projects/33f2118e77114888b83b37f715578386/users/17c2b2371137433bac46c028b5183672/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:24.091394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:24.091692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:24.091990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:24.128025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] MFA Rules not processed for user `17c2b2371137433bac46c028b5183672`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:24.129542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:24.269714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 895/1785] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:24.280951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:24.282703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:24.343539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65adb-5396-4ed0-9a8e-dcdb5a92c46b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:24.351166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80377ba-a15a-48e8-9385-b2ecf15d28f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:24.352004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80377ba-a15a-48e8-9385-b2ecf15d28f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:24.352413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80377ba-a15a-48e8-9385-b2ecf15d28f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:24.352821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80377ba-a15a-48e8-9385-b2ecf15d28f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:24.424169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80377ba-a15a-48e8-9385-b2ecf15d28f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:24.427283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80377ba-a15a-48e8-9385-b2ecf15d28f1 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:24.449363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 891/1786] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:24.493721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:24.691311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:25.371645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:25.504078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:25.505555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:25.519463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d8b49-a145-43ed-a2ed-dfe6ce28473b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:25.524691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:25.525579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:25.526017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:25.526469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:25.529328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:25.640809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:25.642269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581925a-851a-4a05-942b-4d47572c62ca service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:25.654019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 896/1787] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:28.307886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a618a3-4623-46f6-beb0-9f1ed6c3c5cd None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:28.310053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a618a3-4623-46f6-beb0-9f1ed6c3c5cd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:28.310053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a618a3-4623-46f6-beb0-9f1ed6c3c5cd None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:28.313948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 892/1788] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:36:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:36:28.364580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:28.365072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:28.365413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:28.394174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:28.396419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:28.560967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 897/1789] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:36:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:28.762693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a618a3-4623-46f6-beb0-9f1ed6c3c5cd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:28.764741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b4a618a3-4623-46f6-beb0-9f1ed6c3c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:28.782892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:28.783617 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a618a3-4623-46f6-beb0-9f1ed6c3c5cd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:28.789085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:28.789766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:28.790051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:28.790329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:28.800354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:28.802034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:28.813972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 893/1790] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:31.076262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:31.085580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65a335-e2dd-4da6-ace8-9ef29cbe7186 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:31.089430 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8307f-e1b0-4a51-9ee4-f6efb4bec4b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:31.090420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8307f-e1b0-4a51-9ee4-f6efb4bec4b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:31.090705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8307f-e1b0-4a51-9ee4-f6efb4bec4b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:31.093823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8307f-e1b0-4a51-9ee4-f6efb4bec4b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:31.105905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8307f-e1b0-4a51-9ee4-f6efb4bec4b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:31.107632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8307f-e1b0-4a51-9ee4-f6efb4bec4b8 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:31.118804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 898/1791] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:31.699420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:33.886550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:33.887987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:33.957420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4ab605-cc96-47ef-820e-ff31b672387b service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:33.962006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:33.962879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:33.963159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:33.963431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] PATH_INFO: `/v3/users/a39ac59960f6424289b8d45938911739` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:33.964640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a39ac59960f6424289b8d45938911739)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:33.966581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:33.992503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:34.185954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a39ac59960f6424289b8d45938911739'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:34.198460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a39ac59960f6424289b8d45938911739'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:34.199168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a39ac59960f6424289b8d45938911739'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:34.206527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a39ac59960f6424289b8d45938911739'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:34.299307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a39ac59960f6424289b8d45938911739'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:34.305683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 894/1792] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:33 2022] DELETE /identity/v3/users/a39ac59960f6424289b8d45938911739 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:34.310129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:34.310597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:34.310698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:34.330288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:34.332297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:34.370901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:34.391690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 899/1793] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:34.401853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:34.403315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:34.466404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cf2ae2-4e8f-45e2-8f36-5c7dc02b057d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:34.470623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:34.471272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:34.471552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:34.471929 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:34.481470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:34.484413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:34.495948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 895/1794] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:35.132723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:35.134234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:35.152734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e07d16-abea-4947-b833-355cdd56ea89 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:35.161757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:35.162827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:35.163205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:35.164067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] PATH_INFO: `/v3/projects/a2939e32a6b3433d9baae3ca3da15ecc` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:35.165502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2939e32a6b3433d9baae3ca3da15ecc)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:35.167706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:35.361548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2939e32a6b3433d9baae3ca3da15ecc', 'request_id': 'req-94bf904d-371c-49ca-953b-d0e3da6ad6e1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.368338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2939e32a6b3433d9baae3ca3da15ecc', 'request_id': 'req-94bf904d-371c-49ca-953b-d0e3da6ad6e1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.469230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2939e32a6b3433d9baae3ca3da15ecc', 'request_id': 'req-94bf904d-371c-49ca-953b-d0e3da6ad6e1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.483401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] The token cache is being invalidate because project a2939e32a6b3433d9baae3ca3da15ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:35.483891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.484552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.486650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 900/1795] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:35 2022] DELETE /identity/v3/projects/a2939e32a6b3433d9baae3ca3da15ecc => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:35.490792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:35.507545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4638409-da93-4ed1-bccb-fa5b795f334b service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:35.589251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:35.590542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:35.591127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:35.591693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] PATH_INFO: `/v3/users/eceba281e66243ce9513bca226b6883d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:35.593701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eceba281e66243ce9513bca226b6883d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:35.596015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:35.834835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:35.836445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eceba281e66243ce9513bca226b6883d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.849892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eceba281e66243ce9513bca226b6883d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.850643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eceba281e66243ce9513bca226b6883d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.857446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eceba281e66243ce9513bca226b6883d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.949369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a536c922-cce3-4511-95ba-a2dd1d384b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eceba281e66243ce9513bca226b6883d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:35.956026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 896/1796] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:35 2022] DELETE /identity/v3/users/eceba281e66243ce9513bca226b6883d => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:36.446904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:36.449071 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:36.477906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf904d-371c-49ca-953b-d0e3da6ad6e1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:36.601928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:36.603431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:36.604119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:36.604692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] PATH_INFO: `/v3/projects/70840b6b04ca4dd6a3549af65d22fd39` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:36.606236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=70840b6b04ca4dd6a3549af65d22fd39)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:36.609236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:36.755918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70840b6b04ca4dd6a3549af65d22fd39', 'request_id': 'req-51863c36-d270-4508-bc8f-cf81ef23ba1c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:36.763954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70840b6b04ca4dd6a3549af65d22fd39', 'request_id': 'req-51863c36-d270-4508-bc8f-cf81ef23ba1c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:36.905569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70840b6b04ca4dd6a3549af65d22fd39', 'request_id': 'req-51863c36-d270-4508-bc8f-cf81ef23ba1c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:36.910811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:36.917559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] The token cache is being invalidate because project 70840b6b04ca4dd6a3549af65d22fd39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:36.917849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:36.918490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-51863c36-d270-4508-bc8f-cf81ef23ba1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:36.920056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 901/1797] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:36 2022] DELETE /identity/v3/projects/70840b6b04ca4dd6a3549af65d22fd39 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:36.925533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:36.925989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:36.926112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:36.946979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:36.948353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.010525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 897/1798] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:37.019016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.022315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.022667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.043259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:37.044586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.059492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.065354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 902/1799] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:37.070080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009361e-526f-4700-81dd-f23269a715e7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.076854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.077859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.078374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.083174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.083174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:37.083174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.083174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.100768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 898/1800] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:37.102591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.113852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957fb5c-f305-436a-b661-71f5cd86d227 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.118830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.119514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.119783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.120065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.120872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.123126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.272802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 903/1801] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:37 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:37.277023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.287477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0a6a9-284a-4209-8f47-0f227d9cc93c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.357700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.358354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.358626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.358904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.359579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.361641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.426160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.427951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.440780 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910050-ee78-40a9-8dd2-fe27ad1fd279 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.446109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.447119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.447712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.447712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] PATH_INFO: `/v3/users/50a6b08173234824a60337e27e2813bd` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.448940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a6b08173234824a60337e27e2813bd)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.450904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.460436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 899/1802] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:37 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:37.464498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.475836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935a615-1209-44ea-af9e-9bb50183fdfa admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.480548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.482280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.482563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.482882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.483608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.485227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.496424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 900/1803] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:37.500388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.511834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ede636-f5b7-48b7-895b-27b948892e17 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.518009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.518902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.519236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.519514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.520374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.521987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.536744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 901/1804] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:37.541594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.556024 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dde46-7524-4b7e-8b71-ae50654a0ddf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.561707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a77d38-012c-4e29-ab3a-859d2da65dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.562765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77d38-012c-4e29-ab3a-859d2da65dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.563174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77d38-012c-4e29-ab3a-859d2da65dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.563481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a77d38-012c-4e29-ab3a-859d2da65dc8 admin admin] PATH_INFO: `/v3/projects/7f044eec00a34bd3ac29be67c9eab8d4/users/fcb6d0eefeb741edbc1d996b7b8ebec2/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.578602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:37.581043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77d38-012c-4e29-ab3a-859d2da65dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f044eec00a34bd3ac29be67c9eab8d4, user_id=fcb6d0eefeb741edbc1d996b7b8ebec2, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.584013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a77d38-012c-4e29-ab3a-859d2da65dc8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.658211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a6b08173234824a60337e27e2813bd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:37.659175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a6b08173234824a60337e27e2813bd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:37.666219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 902/1805] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:37 2022] PUT /identity/v3/projects/7f044eec00a34bd3ac29be67c9eab8d4/users/fcb6d0eefeb741edbc1d996b7b8ebec2/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:37.677338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.677897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.678605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.720787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] MFA Rules not processed for user `fcb6d0eefeb741edbc1d996b7b8ebec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:37.722400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.739868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a6b08173234824a60337e27e2813bd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:37.751056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a6b08173234824a60337e27e2813bd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:37.757558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e56f5493-001b-405c-b674-44ccf5ada27a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a6b08173234824a60337e27e2813bd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:37.780987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 904/1806] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:37 2022] DELETE /identity/v3/users/50a6b08173234824a60337e27e2813bd => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:37.785629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.786088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.786427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.806273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:37.807887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.824994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 903/1807] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:37.829606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.831332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.895329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 905/1808] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:37.907107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:37.908684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:37.909175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801591e4-9b64-4bdf-945c-dbb0569713f3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.914200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.914828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.915924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.915924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.916288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.918315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.971344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd081ba3-cfb5-49ce-8bfe-a8a75dae24b5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:37.975698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:37.976489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:37.978979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:37.978979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:37.988215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:37.989828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:37.998661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:38.003085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 906/1809] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:38.021436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 904/1810] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:37 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:38.035698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.049995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d408a-1f8e-4683-b5ab-be8e7c04ee24 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.120303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.121030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.121412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.121729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.122463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.124470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:38.210559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 907/1811] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:38 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:38.214356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.230262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce224ed-73b0-4147-a51b-17b4cac0aa6f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.244862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.244862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.244862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.244862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.245420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.245420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:38.263044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 905/1812] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:38.265415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.280680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff348f-fae4-402d-8fb4-965d10cedf97 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.289320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.290413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.290769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.291119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] PATH_INFO: `/v3/projects/77d3f753417244eeae5a2cde64ec742d/users/f0bd957054964087bc85b564cc2975e0/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.309949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d3f753417244eeae5a2cde64ec742d, user_id=f0bd957054964087bc85b564cc2975e0, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.313033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:38.387258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 908/1813] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:38 2022] PUT /identity/v3/projects/77d3f753417244eeae5a2cde64ec742d/users/f0bd957054964087bc85b564cc2975e0/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:38.399915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.412667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9eaa1c-8259-4143-acd8-50653f170e69 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.468729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:38.477116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa77b04-3cef-4167-8526-05a703395831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.477654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77b04-3cef-4167-8526-05a703395831 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.477993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77b04-3cef-4167-8526-05a703395831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.478347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa77b04-3cef-4167-8526-05a703395831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.479141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa77b04-3cef-4167-8526-05a703395831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.481082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa77b04-3cef-4167-8526-05a703395831 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:38.505827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 906/1814] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:38.509597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.522411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7d601-f9b4-4b32-9eb9-51243078ab56 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.527496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.528401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.528748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.529030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] PATH_INFO: `/v3/projects/77d3f753417244eeae5a2cde64ec742d/users/f0bd957054964087bc85b564cc2975e0/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.531577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d3f753417244eeae5a2cde64ec742d, user_id=f0bd957054964087bc85b564cc2975e0, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.534419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:38.560798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 909/1815] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:38 2022] PUT /identity/v3/projects/77d3f753417244eeae5a2cde64ec742d/users/f0bd957054964087bc85b564cc2975e0/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:38.567529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.567942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.568355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.604258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] MFA Rules not processed for user `f0bd957054964087bc85b564cc2975e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:38.605702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:38.712251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 907/1816] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:38 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:38.742692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.744633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:38.798460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:38.799900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:38.812286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73269cf6-871a-46cb-b7fe-779a2f0926fc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.822380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.823077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.823322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.824684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.844590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.846057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:38.856970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 910/1817] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:38.884745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3ef92-2058-4f21-a214-eecb29188667 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:38.889998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:38.890844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:38.891145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:38.891418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] PATH_INFO: `/v3/projects/af000b56671c4708a69ed1d62af12989` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:38.892596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af000b56671c4708a69ed1d62af12989)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:38.894570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:39.016771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af000b56671c4708a69ed1d62af12989', 'request_id': 'req-03706b44-3607-4d83-838d-10ccef08f280'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.022915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af000b56671c4708a69ed1d62af12989', 'request_id': 'req-03706b44-3607-4d83-838d-10ccef08f280'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.036504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af000b56671c4708a69ed1d62af12989', 'request_id': 'req-03706b44-3607-4d83-838d-10ccef08f280'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.155413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] The token cache is being invalidate because project af000b56671c4708a69ed1d62af12989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:39.155732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.156383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.158209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 908/1818] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:38 2022] DELETE /identity/v3/projects/af000b56671c4708a69ed1d62af12989 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:39.162058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:39.173249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e8c4a-2c7d-4861-b61f-2281cbcb529a service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:39.249322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:39.249980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:39.250326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:39.250798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] PATH_INFO: `/v3/users/17c2b2371137433bac46c028b5183672` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:39.252175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c2b2371137433bac46c028b5183672)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:39.254279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:39.390143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:39.432904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c2b2371137433bac46c028b5183672'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.433564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c2b2371137433bac46c028b5183672'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.505790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c2b2371137433bac46c028b5183672'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.513444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c2b2371137433bac46c028b5183672'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.514078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c2b2371137433bac46c028b5183672'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:39.531438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 911/1819] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:39 2022] DELETE /identity/v3/users/17c2b2371137433bac46c028b5183672 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:40.002550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:40.004075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:40.016960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03706b44-3607-4d83-838d-10ccef08f280 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:40.021009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:40.141936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:40.142954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.144749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.144749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] PATH_INFO: `/v3/users/fcb6d0eefeb741edbc1d996b7b8ebec2` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.146009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb6d0eefeb741edbc1d996b7b8ebec2)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:40.148759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:40.176074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:40.182265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:40.215228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ab796-a658-4ff9-9cd9-1e33e725db3f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:40.222482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:40.224386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.224745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.225069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] PATH_INFO: `/v3/projects/33f2118e77114888b83b37f715578386` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.226549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f2118e77114888b83b37f715578386)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:40.229217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:40.467759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f2118e77114888b83b37f715578386', 'request_id': 'req-a5a4d263-9e64-47d4-8532-62cb8dd20145'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.472057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb6d0eefeb741edbc1d996b7b8ebec2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.476698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f2118e77114888b83b37f715578386', 'request_id': 'req-a5a4d263-9e64-47d4-8532-62cb8dd20145'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.492764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb6d0eefeb741edbc1d996b7b8ebec2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.499926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb6d0eefeb741edbc1d996b7b8ebec2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.503556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb6d0eefeb741edbc1d996b7b8ebec2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.614294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f2118e77114888b83b37f715578386', 'request_id': 'req-a5a4d263-9e64-47d4-8532-62cb8dd20145'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.630282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] The token cache is being invalidate because project 33f2118e77114888b83b37f715578386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:40.630792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.631677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a5a4d263-9e64-47d4-8532-62cb8dd20145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.633531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 912/1820] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:40 2022] DELETE /identity/v3/projects/33f2118e77114888b83b37f715578386 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:40.639321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bcea1-0ca7-4af0-a37c-0a9196ac2c29 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.639612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bcea1-0ca7-4af0-a37c-0a9196ac2c29 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.639893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bcea1-0ca7-4af0-a37c-0a9196ac2c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.658510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-148bcea1-0ca7-4af0-a37c-0a9196ac2c29 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:40.659710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-148bcea1-0ca7-4af0-a37c-0a9196ac2c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:40.694324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-67efd5d1-354c-44c3-836f-34365f01da32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb6d0eefeb741edbc1d996b7b8ebec2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:40.701098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:40.702865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 909/1821] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:40 2022] DELETE /identity/v3/users/fcb6d0eefeb741edbc1d996b7b8ebec2 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:40.710324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.710643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.710890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.730446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:40.732360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:40.736241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 913/1822] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:40.746039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.746395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.746895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.770120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:40.771327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:40.811301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 910/1823] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:40.835736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 914/1824] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:40.840157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:40.851023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2245472-6e7d-4f97-8e93-ac11cdcef185 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:40.855872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:40.856550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.856865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.857142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.857892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:40.858801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:40.860649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:40.876678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 911/1825] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:40.877916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:40.887797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f4c05-e606-465b-be9a-fc9eb26f84c8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:40.892783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:40.893367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:40.893667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:40.893946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:40.894669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:40.896842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.018535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 915/1826] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:40 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:41.023128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.035393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.039164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb16dc-1fc1-436f-99c0-71fee9793d57 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.042629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:41.114392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12b7f9-f46b-464a-8bdb-b0143f427961 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.118216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.118872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.119156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.119257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.119448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.120426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.120749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.121079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.123170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.126884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.135323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.136973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.147969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 916/1827] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:41.212032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 912/1828] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:41 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:41.217047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.230418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b672f-05ca-47e7-b3db-6d5755f7abc2 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.236352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.237160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.237533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.237886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.238708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.240841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.255571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 917/1829] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:41.256430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.272857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d2c29-b5f1-4e60-bb2f-c170374dfa9b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.279294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981270d-9d14-4148-9f97-6110ce480dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.280826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981270d-9d14-4148-9f97-6110ce480dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.281113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981270d-9d14-4148-9f97-6110ce480dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.281496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981270d-9d14-4148-9f97-6110ce480dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.282292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981270d-9d14-4148-9f97-6110ce480dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.284440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981270d-9d14-4148-9f97-6110ce480dd5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.300460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 913/1830] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:41.302165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.313001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617e59-7614-4b2d-8e28-8e95fdff19e4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.319712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.320605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.320922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.321202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] PATH_INFO: `/v3/projects/4b901860871049e7b72b0c936468d1cd/users/310238d4c0d744f5b6a999bcb51e7c8a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.338192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b901860871049e7b72b0c936468d1cd, user_id=310238d4c0d744f5b6a999bcb51e7c8a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.340848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.426954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 918/1831] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:41 2022] PUT /identity/v3/projects/4b901860871049e7b72b0c936468d1cd/users/310238d4c0d744f5b6a999bcb51e7c8a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:41.438860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.439175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.439453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.494213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] MFA Rules not processed for user `310238d4c0d744f5b6a999bcb51e7c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:41.494213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:41.592129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:41.633869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 914/1832] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:41.647838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.649822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:41.715734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e533bb9-83c5-4e27-ae17-1a120f3848c0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.721295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.721975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.722663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.722663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.733678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.735288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.750258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 919/1833] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:41.797012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.914471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3a75f-2199-4638-8f73-c374945b2c99 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.922311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.923463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.924110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.925333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] PATH_INFO: `/v3/users/310238d4c0d744f5b6a999bcb51e7c8a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.926907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=310238d4c0d744f5b6a999bcb51e7c8a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.928818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:41.955792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:41.959490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:41.975067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdad6e2-3304-40c2-996d-17bd1f79fc24 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:41.980460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:41.981574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:41.981926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:41.986039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] PATH_INFO: `/v3/projects/7f044eec00a34bd3ac29be67c9eab8d4` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:41.986039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f044eec00a34bd3ac29be67c9eab8d4)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:41.986244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:42.170401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310238d4c0d744f5b6a999bcb51e7c8a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.182763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310238d4c0d744f5b6a999bcb51e7c8a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.183808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310238d4c0d744f5b6a999bcb51e7c8a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.191915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f044eec00a34bd3ac29be67c9eab8d4', 'request_id': 'req-d867d826-2e0f-4540-835c-cc7fa88fe4e4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.197447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310238d4c0d744f5b6a999bcb51e7c8a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.205279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f044eec00a34bd3ac29be67c9eab8d4', 'request_id': 'req-d867d826-2e0f-4540-835c-cc7fa88fe4e4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.298955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-97fa6521-faba-4934-b5dc-7e877169f1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310238d4c0d744f5b6a999bcb51e7c8a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.306721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 915/1834] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:41 2022] DELETE /identity/v3/users/310238d4c0d744f5b6a999bcb51e7c8a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:42.312036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:42.312503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:42.313190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:42.339047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:42.340267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:42.352960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f044eec00a34bd3ac29be67c9eab8d4', 'request_id': 'req-d867d826-2e0f-4540-835c-cc7fa88fe4e4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.370549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] The token cache is being invalidate because project 7f044eec00a34bd3ac29be67c9eab8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:42.394660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.395707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.404197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 920/1835] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:41 2022] DELETE /identity/v3/projects/7f044eec00a34bd3ac29be67c9eab8d4 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:42.421199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:42.425793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:42.536274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 916/1836] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:42.543628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:42.550853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867d826-2e0f-4540-835c-cc7fa88fe4e4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:42.557602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:42.559888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:42.575456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:42.576713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:42.577891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:42.578348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] PATH_INFO: `/v3/users/f0bd957054964087bc85b564cc2975e0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:42.581502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0bd957054964087bc85b564cc2975e0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:42.584038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:42.649578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7417a22-108b-4629-99e8-1f1ffd1b0568 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:42.654076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:42.654745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:42.655081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:42.655364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:42.667289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:42.669041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:42.681107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 917/1837] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:42.839402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0bd957054964087bc85b564cc2975e0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.842196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0bd957054964087bc85b564cc2975e0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.951044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0bd957054964087bc85b564cc2975e0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.960587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0bd957054964087bc85b564cc2975e0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.961462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0bd957054964087bc85b564cc2975e0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:42.985682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 921/1838] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:42 2022] DELETE /identity/v3/users/f0bd957054964087bc85b564cc2975e0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:43.140496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:43.142609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:43.188553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47161a1-bd31-42c8-803b-32eb0e3090a3 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:43.281356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:43.282316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:43.282605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:43.282940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] PATH_INFO: `/v3/users/ecfc5f92d5df44799abdcc42d65cc9be` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:43.285405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfc5f92d5df44799abdcc42d65cc9be)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:43.290922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:43.448979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:43.450707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:43.468236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b656ec-ef57-466c-b815-81830ce473f4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:43.475591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:43.476779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:43.480826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:43.480826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] PATH_INFO: `/v3/projects/4b901860871049e7b72b0c936468d1cd` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:43.480826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b901860871049e7b72b0c936468d1cd)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:43.482714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:43.495222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfc5f92d5df44799abdcc42d65cc9be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.525675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfc5f92d5df44799abdcc42d65cc9be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.529480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfc5f92d5df44799abdcc42d65cc9be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.551087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfc5f92d5df44799abdcc42d65cc9be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.658153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b901860871049e7b72b0c936468d1cd', 'request_id': 'req-64802d6b-16a7-4f5f-b939-b0637414a29b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.665651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b901860871049e7b72b0c936468d1cd', 'request_id': 'req-64802d6b-16a7-4f5f-b939-b0637414a29b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.687840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-04883012-89f7-4254-bbb6-e53569a9cd42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfc5f92d5df44799abdcc42d65cc9be'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.695315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 918/1839] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:43 2022] DELETE /identity/v3/users/ecfc5f92d5df44799abdcc42d65cc9be => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:43.699706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6aeec-2b9d-4bb2-9617-0e3b7e62b284 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:43.699992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6aeec-2b9d-4bb2-9617-0e3b7e62b284 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:43.700270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6aeec-2b9d-4bb2-9617-0e3b7e62b284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:43.719955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-dba6aeec-2b9d-4bb2-9617-0e3b7e62b284 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:43.721128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dba6aeec-2b9d-4bb2-9617-0e3b7e62b284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:43.784841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b901860871049e7b72b0c936468d1cd', 'request_id': 'req-64802d6b-16a7-4f5f-b939-b0637414a29b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.787150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:43.799827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] The token cache is being invalidate because project 4b901860871049e7b72b0c936468d1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:43.800507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.801629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:43.805459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 919/1840] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:43.807123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 922/1841] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:43 2022] DELETE /identity/v3/projects/4b901860871049e7b72b0c936468d1cd => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:43.812262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b8025-28c8-48df-ac0c-29d031dc6e20 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:43.813454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b8025-28c8-48df-ac0c-29d031dc6e20 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:43.813454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b8025-28c8-48df-ac0c-29d031dc6e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:43.838860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:43.840427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:43.869556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d93b8025-28c8-48df-ac0c-29d031dc6e20 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:43.870842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d93b8025-28c8-48df-ac0c-29d031dc6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:43.889637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 920/1842] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:43.911947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:43.912100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:43.913628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:43.957204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:43.958451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:43.983022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 921/1843] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:43.984476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:43.990343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64802d6b-16a7-4f5f-b939-b0637414a29b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.003277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6a988-8e07-4e7d-87fd-6b02e4d827cc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.018862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.020189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.020477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.020854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.021646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:44.021962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.023882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.043513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:44.050888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 922/1844] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:44.052906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.071870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe20ebc-7762-473a-a1d2-515b704076b5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.078143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.079092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.079562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.079927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.080719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.082732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.107239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.107998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.108950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.109303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.111778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:44.125212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.126906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.139155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 923/1845] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:44.178118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.179593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:44.204510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a240a-5779-426e-9580-339f08f57d8d service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.208587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.209967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.210329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.210686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] PATH_INFO: `/v3/projects/77d3f753417244eeae5a2cde64ec742d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.211587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 923/1846] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:44.216048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d3f753417244eeae5a2cde64ec742d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.216482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.219129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.359777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286316cf-d5a5-48ad-af40-1d5c4c882406 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.370863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d3f753417244eeae5a2cde64ec742d', 'request_id': 'req-66d7c5f8-6d26-4057-95d0-18820f49ec32'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:44.378008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d3f753417244eeae5a2cde64ec742d', 'request_id': 'req-66d7c5f8-6d26-4057-95d0-18820f49ec32'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:44.460528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.461387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.461796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.462076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.462789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.463180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d3f753417244eeae5a2cde64ec742d', 'request_id': 'req-66d7c5f8-6d26-4057-95d0-18820f49ec32'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:44.464776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.477709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] The token cache is being invalidate because project 77d3f753417244eeae5a2cde64ec742d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:44.478096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:44.478922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-66d7c5f8-6d26-4057-95d0-18820f49ec32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:44.486018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 924/1847] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:44 2022] DELETE /identity/v3/projects/77d3f753417244eeae5a2cde64ec742d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:44.488330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d005-ccae-4f6e-bf16-9bf22f415834 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.489013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d005-ccae-4f6e-bf16-9bf22f415834 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.489129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6d005-ccae-4f6e-bf16-9bf22f415834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.554440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 924/1848] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/users => generated 289 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:44.559288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.562386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:44.577007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dde6d005-ccae-4f6e-bf16-9bf22f415834 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:44.583866 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dde6d005-ccae-4f6e-bf16-9bf22f415834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:44.588728 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d56f219-85ec-466f-b13f-3613fc6f1750 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.611862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.614207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.614613 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.615122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.617496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.629044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 925/1849] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:44.629138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.633410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.633924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.634417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.657846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 925/1850] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:44.662611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.684209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e4212-5038-4a38-a33b-463ede8af9f6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.686193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:44.708343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:44.720724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.722113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.727551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 926/1851] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:44.728436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.728948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.729381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.730126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.734457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.758486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 926/1852] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:44.758763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368fe68-9c46-49ed-9d12-e092da7064d2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.768428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.769189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.769573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.769703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.770183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.771061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:44.771659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.773452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.779697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d786fab-c798-4548-ab4a-374c60e550b3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.794465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 927/1853] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:36:44.794655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01e0ef-9b0e-4fb6-8752-571255b0f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.798715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e0ef-9b0e-4fb6-8752-571255b0f8fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.798715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e0ef-9b0e-4fb6-8752-571255b0f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.798715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01e0ef-9b0e-4fb6-8752-571255b0f8fe admin admin] PATH_INFO: `/v3/projects/ed17af212d874107a18a980bdc5ba8b0/users/6c458be558f34554a280573f6a4146f9/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.799965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:44.832042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e0ef-9b0e-4fb6-8752-571255b0f8fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed17af212d874107a18a980bdc5ba8b0, user_id=6c458be558f34554a280573f6a4146f9, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.836683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01e0ef-9b0e-4fb6-8752-571255b0f8fe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.843888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d5293-56d8-4cad-9a6e-c087fb631ef3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:44.856870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:44.859540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.859540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.859540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.860026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:44.862900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:44.946854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 927/1854] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:44 2022] PUT /identity/v3/projects/ed17af212d874107a18a980bdc5ba8b0/users/6c458be558f34554a280573f6a4146f9/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:44.957467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:44.958592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:44.960949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:44.977497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 928/1855] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:44.981600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.007159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] MFA Rules not processed for user `6c458be558f34554a280573f6a4146f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:45.008811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:45.098690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c27434-bf84-4732-9414-75eadc12deb7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.104006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.105073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.105496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.105919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.106833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.109554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.148023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 928/1856] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:45.149032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.150421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:45.164948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98500f21-34b8-461a-818a-d78cf93bb7a5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.169758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.170675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.171134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.171412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] PATH_INFO: `/v3/projects/488cce6db76949c99379a533279b21f9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.172675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488cce6db76949c99379a533279b21f9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.174629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.216190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 929/1857] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:44 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:45.222298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.226156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:45.332306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488cce6db76949c99379a533279b21f9', 'request_id': 'req-62a62345-5ff9-4b1a-8500-10199ba06d30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:45.345006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488cce6db76949c99379a533279b21f9', 'request_id': 'req-62a62345-5ff9-4b1a-8500-10199ba06d30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:45.357870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488cce6db76949c99379a533279b21f9', 'request_id': 'req-62a62345-5ff9-4b1a-8500-10199ba06d30'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:45.369855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b89eb-8447-4fc7-b38e-814a4a1314d7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.435348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.437472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.437760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.438043 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.460554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] The token cache is being invalidate because project 488cce6db76949c99379a533279b21f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:45.461237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:45.462315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:45.464180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 929/1858] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:45 2022] DELETE /identity/v3/projects/488cce6db76949c99379a533279b21f9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:45.465275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.468011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:45.543042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.544606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.555896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 930/1859] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:45.556807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.586077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a62345-5ff9-4b1a-8500-10199ba06d30 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.600874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.601564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.601990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.602276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.603331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.605007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.637494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:45.638312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 930/1860] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:45.639280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.654693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f04f0-4baa-4643-948b-37248b92ab1b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.670594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.675907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.675907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.675907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.675907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.677473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.683422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7808986-15c1-4f90-b8eb-e212b5720099 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.709978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.711502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.711788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.712069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] PATH_INFO: `/v3/users/fe89ecf298e74137a2091a032737e9c2` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.713413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe89ecf298e74137a2091a032737e9c2)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.715715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.716108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 931/1861] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:45.721014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:45.752403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c61b89-12b6-4c2b-8a3f-5d5956b4232c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:45.764027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c5b94-6063-424c-8147-5b7aa5e7c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:45.765109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5b94-6063-424c-8147-5b7aa5e7c964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.765371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5b94-6063-424c-8147-5b7aa5e7c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.765701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c5b94-6063-424c-8147-5b7aa5e7c964 admin admin] PATH_INFO: `/v3/projects/9e48e8991a704336aa86b7d6eec754f7/users/bd27a399ce624de6a48770a50da3fd7f/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.805542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5b94-6063-424c-8147-5b7aa5e7c964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e48e8991a704336aa86b7d6eec754f7, user_id=bd27a399ce624de6a48770a50da3fd7f, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:45.809769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c5b94-6063-424c-8147-5b7aa5e7c964 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:45.917369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 932/1862] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:45 2022] PUT /identity/v3/projects/9e48e8991a704336aa86b7d6eec754f7/users/bd27a399ce624de6a48770a50da3fd7f/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:45.919268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:45.920701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:45.921858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:45.980163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe89ecf298e74137a2091a032737e9c2'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:45.982297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe89ecf298e74137a2091a032737e9c2'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:46.005620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] MFA Rules not processed for user `bd27a399ce624de6a48770a50da3fd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:46.008118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:46.071854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe89ecf298e74137a2091a032737e9c2'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:46.075790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:46.089116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe89ecf298e74137a2091a032737e9c2'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:46.090577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe89ecf298e74137a2091a032737e9c2'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:46.147784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 931/1863] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:45 2022] DELETE /identity/v3/users/fe89ecf298e74137a2091a032737e9c2 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:46.175213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 933/1864] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:46.184150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:46.185783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:46.357230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113bcc72-8fdc-4c35-ae6a-c151ccc1022f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:46.363392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:46.364142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:46.364545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:46.364963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:46.365650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:46.367728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:46.511240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 932/1865] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:46 2022] POST /identity/v3/projects => generated 377 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:46.514291 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:46.656517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b52a8b-c300-4b32-b1ce-c1bfc9c29f6e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:46.760343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:46.761209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:46.761494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:46.761773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:46.762652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:46.764567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:46.814319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:46.816045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:46.830618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df02413-2ace-45e1-98d3-2b68663a873b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:46.835280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:46.836861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:46.839146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:46.839146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] PATH_INFO: `/v3/projects/fdbc6b4a37284fbd88542363aead49ca` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:46.839146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbc6b4a37284fbd88542363aead49ca)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:46.840584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:46.873660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 934/1866] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:46 2022] POST /identity/v3/users => generated 289 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:46.873660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:46.892533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0bb4b-a55f-4b3b-b263-4f82acf590bf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:46.897779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:46.898451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:46.898730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:46.899032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:46.899768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:46.901467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:46.912881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 935/1867] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:46.916737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:46.927535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1020c8f-d4db-4be5-945c-d6f56a224773 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:46.932369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:46.933115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:46.933409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:46.933683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:46.934416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:46.936089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:46.948444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 936/1868] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:46.952019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:46.962836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7762ebe-8ec6-4436-9fa0-173fb4a4e55a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:46.974632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbc6b4a37284fbd88542363aead49ca', 'request_id': 'req-9c04612c-a460-45d7-aec6-24cdac9c7e5d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:46.981466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbc6b4a37284fbd88542363aead49ca', 'request_id': 'req-9c04612c-a460-45d7-aec6-24cdac9c7e5d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:47.020723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce61a58-2a7d-4ae3-a08a-ee035b1072bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.021611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61a58-2a7d-4ae3-a08a-ee035b1072bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.021888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61a58-2a7d-4ae3-a08a-ee035b1072bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.022161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce61a58-2a7d-4ae3-a08a-ee035b1072bc admin admin] PATH_INFO: `/v3/projects/9c8176af0ddc4ccda8d53376451f97ea/users/8ea140967f674ed6a3df93f307ae1946/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.037664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61a58-2a7d-4ae3-a08a-ee035b1072bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8176af0ddc4ccda8d53376451f97ea, user_id=8ea140967f674ed6a3df93f307ae1946, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.040316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce61a58-2a7d-4ae3-a08a-ee035b1072bc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.049143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbc6b4a37284fbd88542363aead49ca', 'request_id': 'req-9c04612c-a460-45d7-aec6-24cdac9c7e5d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:47.059786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] The token cache is being invalidate because project fdbc6b4a37284fbd88542363aead49ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:47.060056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:47.060697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9c04612c-a460-45d7-aec6-24cdac9c7e5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:47.063091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 933/1869] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:46 2022] DELETE /identity/v3/projects/fdbc6b4a37284fbd88542363aead49ca => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:47.067912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2316a3-8f3a-4a2d-a94c-7ad9c20be292 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.068201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2316a3-8f3a-4a2d-a94c-7ad9c20be292 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.068479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2316a3-8f3a-4a2d-a94c-7ad9c20be292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.085875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ca2316a3-8f3a-4a2d-a94c-7ad9c20be292 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:47.087008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ca2316a3-8f3a-4a2d-a94c-7ad9c20be292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:47.095047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 934/1870] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:47.106085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.106388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.106655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.128247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:47.129549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:47.130027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 937/1871] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:46 2022] PUT /identity/v3/projects/9c8176af0ddc4ccda8d53376451f97ea/users/8ea140967f674ed6a3df93f307ae1946/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:47.141823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.142111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.142387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.170632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] MFA Rules not processed for user `8ea140967f674ed6a3df93f307ae1946`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:47.172496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:47.200144 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 935/1872] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:47.204647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.213478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9a42-a41b-451a-b0d3-123719c4e3d9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.220166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.220895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.221099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.221611 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.222077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:47.222386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.223983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.236821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 936/1873] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:36:47.240868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.245356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 938/1874] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:47.250297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.251815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:47.255483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092ce26-408f-4028-852b-f90099acc8b0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.260405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.266008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.266008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.266008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.266008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.266008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.266371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9172da-cf9c-4466-a27f-3fceb36948bd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.269376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.270069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.270347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.270622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.271306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.273268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.345609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 937/1875] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:47.349670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.375453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 939/1876] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:47.379479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.410816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc8d0a4-7967-4351-8ff8-b869237072f0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.440467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a1469-1886-42a4-ba98-86c5b9fb3cce admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.445532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.446227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.446510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.446796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.447493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.449451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.465712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.470726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.470726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.470726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.470726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.470726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.545081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 940/1877] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:47.549321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.558967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443f9b8-df15-4d5f-887d-aa36439567f8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.563650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.564295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.564583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.564895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.565650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.567530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.576096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 938/1878] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:47.583939 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 941/1879] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:47.586812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.588485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.597888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b05ce-5b60-4fcf-a21d-ea454e0e2a12 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.598670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195733f1-5929-4cf0-bc03-94e8b1796403 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.602991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.603229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.606926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.606926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.607118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.607220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.607307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.607307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] PATH_INFO: `/v3/projects/259f90f250aa4a8ca926c4bb9a037053/users/73cef3961db349ecbc2140df93575f49/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.607469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.607469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.618634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 939/1880] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:47.620241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=259f90f250aa4a8ca926c4bb9a037053, user_id=73cef3961db349ecbc2140df93575f49, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.623035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.623448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.635287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00697a80-7ece-44ba-a9e3-f1a871e6f9e5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.640574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.641525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.642023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.642405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.643139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.644804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.657117 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 940/1881] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:47.661216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.671817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efccac-3c30-41a7-8a0e-08a9736e4489 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.676756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.677728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.678085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.678372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] PATH_INFO: `/v3/projects/1325fc8bd1b04d38a0efec458a19c0d3/users/cc99a7f54bb54539b46295a40bcb3c3a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.696564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1325fc8bd1b04d38a0efec458a19c0d3, user_id=cc99a7f54bb54539b46295a40bcb3c3a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.699567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.730150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 942/1882] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:47 2022] PUT /identity/v3/projects/259f90f250aa4a8ca926c4bb9a037053/users/73cef3961db349ecbc2140df93575f49/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:47.734719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.795948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a860b-1084-44fe-b02f-4df890a7e849 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.801052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36ea29-a8df-4921-9d72-e3b58bef6dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.801722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36ea29-a8df-4921-9d72-e3b58bef6dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.802005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36ea29-a8df-4921-9d72-e3b58bef6dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.802280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36ea29-a8df-4921-9d72-e3b58bef6dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.803017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36ea29-a8df-4921-9d72-e3b58bef6dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.804670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36ea29-a8df-4921-9d72-e3b58bef6dfb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.808458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 941/1883] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:47 2022] PUT /identity/v3/projects/1325fc8bd1b04d38a0efec458a19c0d3/users/cc99a7f54bb54539b46295a40bcb3c3a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:47.814792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 943/1884] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:47.820253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.820422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.820660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.820971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.847617 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] MFA Rules not processed for user `cc99a7f54bb54539b46295a40bcb3c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:47.849164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:47.882126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2bf69-89b8-4f00-8135-6ea43173269b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.887547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573093e3-d306-4cc6-bc27-dbda4ec56832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.888442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573093e3-d306-4cc6-bc27-dbda4ec56832 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.888760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573093e3-d306-4cc6-bc27-dbda4ec56832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.889073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573093e3-d306-4cc6-bc27-dbda4ec56832 admin admin] PATH_INFO: `/v3/projects/259f90f250aa4a8ca926c4bb9a037053/users/73cef3961db349ecbc2140df93575f49/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.898914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573093e3-d306-4cc6-bc27-dbda4ec56832 admin admin] RBAC: Authorizing `identity:create_grant(project_id=259f90f250aa4a8ca926c4bb9a037053, user_id=73cef3961db349ecbc2140df93575f49, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:47.901715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573093e3-d306-4cc6-bc27-dbda4ec56832 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:47.913752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 942/1885] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:47 2022] PUT /identity/v3/projects/259f90f250aa4a8ca926c4bb9a037053/users/73cef3961db349ecbc2140df93575f49/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:47.923824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 944/1886] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:47.924837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:47.925137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.925539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.925895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.935575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e685e85-5463-460d-bd3c-7c90d7824cb4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:47.956336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] MFA Rules not processed for user `73cef3961db349ecbc2140df93575f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:47.957701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:47.995754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:47.996428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:47.996742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:47.997020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:47.997719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.005273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.041948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 943/1887] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:48.054015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.055386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:48.111472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfe8c2-fb1b-477a-8db4-4f0822955d75 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.115074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.115719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.116006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.116284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.128296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 945/1888] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:47 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:48.128471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.128471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.129552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.136867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 944/1889] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:48.198165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:48.200518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5a958-b16e-4ba4-aab5-419fec2d3464 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.205383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.206049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.206333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.206622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.207300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.209314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.237272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.238644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:48.249665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f1fea-1ccd-424c-83a7-661cd78b41c9 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.301833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.303092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.303373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.303659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.305176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 946/1890] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:48 2022] POST /identity/v3/users => generated 300 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:48.308458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:48.308947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.319104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e72c-ddf7-49ee-95c5-c470d0981c27 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.326433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.327097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.327397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.327755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.328496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.330508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.341314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 947/1891] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:48.346095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.356472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bec7f-7d08-4b8e-94c7-43215c3070a1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.363373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.364265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.364543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.364854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] PATH_INFO: `/v3/projects/6bec3fbf4aae4c19ac9d2a5a05b16dfc/users/948831ae91604a6ea4c5938f8af2af48/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.377108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:48.379378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.380197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bec3fbf4aae4c19ac9d2a5a05b16dfc, user_id=948831ae91604a6ea4c5938f8af2af48, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.381037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.384202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.390539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 945/1892] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:48.454896 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 948/1893] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:48 2022] PUT /identity/v3/projects/6bec3fbf4aae4c19ac9d2a5a05b16dfc/users/948831ae91604a6ea4c5938f8af2af48/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:48.458807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.470075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8251d-7947-4867-8ac7-8539fba1efc6 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.528130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ca0c6-4e31-4ea5-a54d-c98746c29a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.528835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ca0c6-4e31-4ea5-a54d-c98746c29a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.529123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ca0c6-4e31-4ea5-a54d-c98746c29a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.529465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ca0c6-4e31-4ea5-a54d-c98746c29a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.530195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ca0c6-4e31-4ea5-a54d-c98746c29a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.532336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ca0c6-4e31-4ea5-a54d-c98746c29a2d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.542640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 946/1894] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:48.547807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.558913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f34c10-d1f0-4eef-acd5-ff60fb4b7bd8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.563751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.565653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.565653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.565653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] PATH_INFO: `/v3/projects/6bec3fbf4aae4c19ac9d2a5a05b16dfc/users/948831ae91604a6ea4c5938f8af2af48/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.568668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bec3fbf4aae4c19ac9d2a5a05b16dfc, user_id=948831ae91604a6ea4c5938f8af2af48, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.571271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.582211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 949/1895] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:48 2022] PUT /identity/v3/projects/6bec3fbf4aae4c19ac9d2a5a05b16dfc/users/948831ae91604a6ea4c5938f8af2af48/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:48.592340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.592670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.592957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.619355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] MFA Rules not processed for user `948831ae91604a6ea4c5938f8af2af48`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:48.620726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:48.686888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 947/1896] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:48.698340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.757092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffae40-0218-488e-a9ef-22ef7b1b48cc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.762394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80cf12-276f-4d70-a629-523e0704bac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.763054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80cf12-276f-4d70-a629-523e0704bac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.763333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80cf12-276f-4d70-a629-523e0704bac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.763602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80cf12-276f-4d70-a629-523e0704bac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.774315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80cf12-276f-4d70-a629-523e0704bac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.775890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80cf12-276f-4d70-a629-523e0704bac0 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:48.786843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 950/1897] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:48.814969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:48.882147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26ca82-e9f2-4650-afcc-20980e907f09 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:48.886729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:48.887703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:48.887982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:48.888257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] PATH_INFO: `/v3/users/cc99a7f54bb54539b46295a40bcb3c3a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:48.889482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc99a7f54bb54539b46295a40bcb3c3a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:48.891906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:49.052903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc99a7f54bb54539b46295a40bcb3c3a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:49.054044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc99a7f54bb54539b46295a40bcb3c3a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:49.123756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc99a7f54bb54539b46295a40bcb3c3a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:49.135713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc99a7f54bb54539b46295a40bcb3c3a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:49.135713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc99a7f54bb54539b46295a40bcb3c3a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:49.152437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 948/1898] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:48 2022] DELETE /identity/v3/users/cc99a7f54bb54539b46295a40bcb3c3a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:49.161099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:49.161406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:49.161760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:49.181154 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:49.182642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:49.300095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 951/1899] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:49.309787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:49.311617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:49.375049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d140b-1c9c-46e9-be65-df20ce9b3d8a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:49.378554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:49.379278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:49.379563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:49.379839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:49.389016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:49.390895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:49.400677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 949/1900] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:50.023710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:50.025342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:50.037526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fce959-c75a-47cc-9f0e-9d4d9f25ae61 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:50.043745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:50.048279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:50.048279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:50.048279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] PATH_INFO: `/v3/projects/1325fc8bd1b04d38a0efec458a19c0d3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:50.048279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1325fc8bd1b04d38a0efec458a19c0d3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:50.049100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:50.129824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:50.210833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1325fc8bd1b04d38a0efec458a19c0d3', 'request_id': 'req-f2448bf9-8b06-413a-ad01-1093ad084f31'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.216367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1325fc8bd1b04d38a0efec458a19c0d3', 'request_id': 'req-f2448bf9-8b06-413a-ad01-1093ad084f31'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.221758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:50.226319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1325fc8bd1b04d38a0efec458a19c0d3', 'request_id': 'req-f2448bf9-8b06-413a-ad01-1093ad084f31'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.372277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] The token cache is being invalidate because project 1325fc8bd1b04d38a0efec458a19c0d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:50.372989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.373780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.375992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 952/1901] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:50 2022] DELETE /identity/v3/projects/1325fc8bd1b04d38a0efec458a19c0d3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:50.380148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:50.390171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d073d60-dae9-4bd2-afa9-4f08ee4006d1 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:50.453308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:50.454334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:50.454541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:50.454791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] PATH_INFO: `/v3/users/948831ae91604a6ea4c5938f8af2af48` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:50.462303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=948831ae91604a6ea4c5938f8af2af48)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:50.463283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:50.679782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948831ae91604a6ea4c5938f8af2af48'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.680460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948831ae91604a6ea4c5938f8af2af48'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.763433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948831ae91604a6ea4c5938f8af2af48'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.775685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948831ae91604a6ea4c5938f8af2af48'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.776362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f7f53401-09e3-4717-a9f8-d348de3a46b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948831ae91604a6ea4c5938f8af2af48'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:50.793529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 950/1902] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:50 2022] DELETE /identity/v3/users/948831ae91604a6ea4c5938f8af2af48 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:51.416228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:51.427574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:51.429069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:51.441897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2448bf9-8b06-413a-ad01-1093ad084f31 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:51.502372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:51.503142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:51.503424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:51.503700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] PATH_INFO: `/v3/projects/6bec3fbf4aae4c19ac9d2a5a05b16dfc` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:51.504925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bec3fbf4aae4c19ac9d2a5a05b16dfc)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:51.507248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:51.681055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bec3fbf4aae4c19ac9d2a5a05b16dfc', 'request_id': 'req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:51.687301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bec3fbf4aae4c19ac9d2a5a05b16dfc', 'request_id': 'req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:51.693630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bec3fbf4aae4c19ac9d2a5a05b16dfc', 'request_id': 'req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:51.842338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] The token cache is being invalidate because project 6bec3fbf4aae4c19ac9d2a5a05b16dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:51.842627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:51.843283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-303877a9-ff2f-4dba-af8a-0eafaa5bcfba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:51.845557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 953/1903] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:51 2022] DELETE /identity/v3/projects/6bec3fbf4aae4c19ac9d2a5a05b16dfc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:51.850550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:51.852346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:51.852346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:51.869365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:51.871693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:51.872975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:51.931305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 951/1904] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:51.939665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:51.939949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:51.940221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:51.959549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:51.960822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:51.968903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 954/1905] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:51.973168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:51.982784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71788c4-1989-4e83-aa72-fe9e6794ecb8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:51.987876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:51.988533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:51.988855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:51.989133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:51.989918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:51.990225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:51.991939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.004035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 952/1906] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:36:52.008523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.019226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9dd98-bd61-49b4-a6d9-0ab430b3904f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.023652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.024349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.024623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.024941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.025604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.027785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.114392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 955/1907] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:52 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:52.120017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.130397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0ad72-c1a7-4d33-8367-450c5c7ecc6c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.188054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.188758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.189044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.189321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.190022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.191919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.301924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 953/1908] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:52 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:52.307741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.318679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23109348-8c23-42b3-85f3-d948ad95c53a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.323339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.323996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.324281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.324559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.325416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.327129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.337937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 956/1909] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:52.342353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.352205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aedf23b-548e-4f7e-88a4-21a3eb45cfe3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.357082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b6f72-32f3-458f-b343-50b5f0306807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.362269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6f72-32f3-458f-b343-50b5f0306807 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.362269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6f72-32f3-458f-b343-50b5f0306807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.362269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b6f72-32f3-458f-b343-50b5f0306807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.362269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6f72-32f3-458f-b343-50b5f0306807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.362269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b6f72-32f3-458f-b343-50b5f0306807 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.372014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 954/1910] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:52.376703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.386893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a8210-84da-48be-b233-27447c4e08e8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.391696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.392569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.392886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.393161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] PATH_INFO: `/v3/projects/54fbd46f89754808bc672a31ef10e93b/users/9ba5bdd8b19c4e8ea0e74a0eda084e19/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.409547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fbd46f89754808bc672a31ef10e93b, user_id=9ba5bdd8b19c4e8ea0e74a0eda084e19, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.412249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.524570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 957/1911] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:52 2022] PUT /identity/v3/projects/54fbd46f89754808bc672a31ef10e93b/users/9ba5bdd8b19c4e8ea0e74a0eda084e19/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:52.536045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfa145-7980-4c21-9574-893891e35496 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.536397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfa145-7980-4c21-9574-893891e35496 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.536799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfa145-7980-4c21-9574-893891e35496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.538164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.545255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:52.572075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-efdfa145-7980-4c21-9574-893891e35496 None None] MFA Rules not processed for user `9ba5bdd8b19c4e8ea0e74a0eda084e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:52.573403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-efdfa145-7980-4c21-9574-893891e35496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:52.611585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677df32-2ca5-4413-ac19-6f72d66773b5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.616356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.617248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.617531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.617880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] PATH_INFO: `/v3/users/bd27a399ce624de6a48770a50da3fd7f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.619146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd27a399ce624de6a48770a50da3fd7f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.621099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.636055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 955/1912] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:52.640688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfa145-7980-4c21-9574-893891e35496 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.650772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfa145-7980-4c21-9574-893891e35496 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.655594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.656782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.657067 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.657342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.658032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.659979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.751223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:52.761498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 956/1913] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:52 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:52.762493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.828360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd27a399ce624de6a48770a50da3fd7f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:52.829057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd06994c-702b-4ef7-ad65-a90d84ca62f6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:52.836409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:52.837382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.837382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.837672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.838412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:52.840425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:52.849573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd27a399ce624de6a48770a50da3fd7f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:52.850547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd27a399ce624de6a48770a50da3fd7f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:52.860008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd27a399ce624de6a48770a50da3fd7f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:52.973951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c50d6de0-a603-4642-b353-fd3602ea439d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd27a399ce624de6a48770a50da3fd7f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:52.979976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 957/1914] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:52 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:52.980475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 958/1915] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:52 2022] DELETE /identity/v3/users/bd27a399ce624de6a48770a50da3fd7f => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:52.987508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:52.987742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:52.988144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:52.988427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:52.989390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:53.002867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f707c6-24f5-4545-9fc9-ef2f5dbe97f9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:53.006683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:53.007905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:53.059755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:53.060382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.060706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.060988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.061721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:53.064154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:53.070071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 959/1916] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:53.075326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 958/1917] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:53.077838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:53.079229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:53.079345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:53.091891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e8ea0-c000-4333-8359-0885498e2478 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:53.097299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:53.098027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.098461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.098809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] PATH_INFO: `/v3/projects/55f524e186dd4d6a93033f9b600dd8c7/users/052686d57a5c49c0a730aeda03cf6e98/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.118054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f524e186dd4d6a93033f9b600dd8c7, user_id=052686d57a5c49c0a730aeda03cf6e98, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:53.121894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:53.146209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e388c9e-604a-4ed9-8fe2-0d162f552483 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:53.150485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:53.151110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.151395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.151674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.161041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:53.162542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:53.173077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 960/1918] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:53.471717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 959/1919] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:53 2022] PUT /identity/v3/projects/55f524e186dd4d6a93033f9b600dd8c7/users/052686d57a5c49c0a730aeda03cf6e98/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:53.474245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:53.485281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776a3f6-a5b6-48d8-89bb-cd167fedb3c7 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:53.550282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:53.556276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76b5d4-034a-4e4d-919e-ad4c2549ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:53.556276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76b5d4-034a-4e4d-919e-ad4c2549ae37 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.556276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76b5d4-034a-4e4d-919e-ad4c2549ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.556276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76b5d4-034a-4e4d-919e-ad4c2549ae37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.560385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76b5d4-034a-4e4d-919e-ad4c2549ae37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:53.560385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76b5d4-034a-4e4d-919e-ad4c2549ae37 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:53.570715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 961/1920] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:53.574985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:53.585188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae2664-0a46-4622-a155-172e92654617 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:53.589814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:53.590765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.591092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.591405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] PATH_INFO: `/v3/projects/55f524e186dd4d6a93033f9b600dd8c7/users/052686d57a5c49c0a730aeda03cf6e98/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.593988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f524e186dd4d6a93033f9b600dd8c7, user_id=052686d57a5c49c0a730aeda03cf6e98, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:53.596640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:53.607090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 960/1921] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:53 2022] PUT /identity/v3/projects/55f524e186dd4d6a93033f9b600dd8c7/users/052686d57a5c49c0a730aeda03cf6e98/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:53.617489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.617781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.618063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.649609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] MFA Rules not processed for user `052686d57a5c49c0a730aeda03cf6e98`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:53.651593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:53.674532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:53.753414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 962/1922] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:53.755073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:53.757754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:53.830166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c23e3ab-d5b4-4032-a3af-03ad027061ed admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:53.833771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:53.834412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:53.834694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:53.834977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:53.844318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:53.845773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:53.855290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 961/1923] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:53 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:36:53.896701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:53.898821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:54.001502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d14d7-c9e6-4459-8e04-0ea6dd90e2f5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:54.007994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:54.009135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:54.009424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:54.009704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] PATH_INFO: `/v3/projects/9e48e8991a704336aa86b7d6eec754f7` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:54.010915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e48e8991a704336aa86b7d6eec754f7)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:54.012849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:54.082624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:54.095739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef85ff-b597-4143-ab69-29c9c249f013 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:54.097672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:54.098394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:54.098882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:54.099358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:54.102842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:54.140049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e48e8991a704336aa86b7d6eec754f7', 'request_id': 'req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.168215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e48e8991a704336aa86b7d6eec754f7', 'request_id': 'req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.178601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e48e8991a704336aa86b7d6eec754f7', 'request_id': 'req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.178766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:54.180135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:54.193781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 962/1924] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:54 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:54.265372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] The token cache is being invalidate because project 9e48e8991a704336aa86b7d6eec754f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:54.268960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.268960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.268960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 963/1925] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:53 2022] DELETE /identity/v3/projects/9e48e8991a704336aa86b7d6eec754f7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:54.272230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:54.284314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aae8f8-3f2f-488c-b0b1-a1452ceadd3b service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:54.347607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:54.348745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:54.349102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:54.349529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] PATH_INFO: `/v3/users/8ea140967f674ed6a3df93f307ae1946` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:54.350840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea140967f674ed6a3df93f307ae1946)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:54.352987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:54.385204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:54.470700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:54.559300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea140967f674ed6a3df93f307ae1946'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.561940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea140967f674ed6a3df93f307ae1946'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.644467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea140967f674ed6a3df93f307ae1946'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.652576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea140967f674ed6a3df93f307ae1946'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.653991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea140967f674ed6a3df93f307ae1946'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:54.674353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 963/1926] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:54 2022] DELETE /identity/v3/users/8ea140967f674ed6a3df93f307ae1946 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:55.167867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:55.174474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:55.176856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:55.203314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a93b2b-4aa7-454f-b9ec-0314c68f72c4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:55.257606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:55.325937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:55.326864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:55.327167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:55.327442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] PATH_INFO: `/v3/projects/9c8176af0ddc4ccda8d53376451f97ea` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:55.329418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8176af0ddc4ccda8d53376451f97ea)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:55.339785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:55.487870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8176af0ddc4ccda8d53376451f97ea', 'request_id': 'req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:55.493895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8176af0ddc4ccda8d53376451f97ea', 'request_id': 'req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:55.501827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8176af0ddc4ccda8d53376451f97ea', 'request_id': 'req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:55.568868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:55.624408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] The token cache is being invalidate because project 9c8176af0ddc4ccda8d53376451f97ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:55.624881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:55.626185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:55.627773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 964/1927] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:55 2022] DELETE /identity/v3/projects/9c8176af0ddc4ccda8d53376451f97ea => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:55.632112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:55.633527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:55.645949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436f86c-417f-48a8-9b12-074e17d27aca admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:55.700861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:55.701738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:55.702027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:55.702334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] PATH_INFO: `/v3/users/73cef3961db349ecbc2140df93575f49` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:55.703646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73cef3961db349ecbc2140df93575f49)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:55.713261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:55.969103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73cef3961db349ecbc2140df93575f49'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:55.970412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73cef3961db349ecbc2140df93575f49'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:56.019745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73cef3961db349ecbc2140df93575f49'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:56.027968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73cef3961db349ecbc2140df93575f49'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:56.028734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22b44825-55b8-40ff-9c69-cf0864cdea3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73cef3961db349ecbc2140df93575f49'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:56.034578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:56.049014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 964/1928] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:55 2022] DELETE /identity/v3/users/73cef3961db349ecbc2140df93575f49 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:56.538918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:56.538918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:56.554726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2bd6c-42cb-4a2b-b962-8ed918b0b42b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:56.777844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:56.778910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:56.783565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:56.786175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] PATH_INFO: `/v3/projects/259f90f250aa4a8ca926c4bb9a037053` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:56.790439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] RBAC: Authorizing `identity:delete_project(project_id=259f90f250aa4a8ca926c4bb9a037053)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:56.798123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:56.900380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:56.982850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '259f90f250aa4a8ca926c4bb9a037053', 'request_id': 'req-be255b3f-e9cc-4ad2-8797-b2979c18f89a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:56.991867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '259f90f250aa4a8ca926c4bb9a037053', 'request_id': 'req-be255b3f-e9cc-4ad2-8797-b2979c18f89a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:57.005940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '259f90f250aa4a8ca926c4bb9a037053', 'request_id': 'req-be255b3f-e9cc-4ad2-8797-b2979c18f89a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:57.093722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] The token cache is being invalidate because project 259f90f250aa4a8ca926c4bb9a037053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:57.094212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:57.094872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-be255b3f-e9cc-4ad2-8797-b2979c18f89a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:57.096709 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 965/1929] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:56 2022] DELETE /identity/v3/projects/259f90f250aa4a8ca926c4bb9a037053 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:57.102632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.102924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.103258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.127079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:57.128291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:57.187354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 965/1930] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:57.197432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.197722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.198001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.217472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:57.219967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:57.229099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 966/1931] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:57.233350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.250862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e4a2c-32ac-484f-a003-2f49bc83da7d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.261265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.262183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.262620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.263048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.265357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:57.269852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.269852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.293476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 966/1932] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:57.302526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.312829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502de9f9-4a6b-484a-9be5-2523caef1464 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.317661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72764-4645-4ca2-8c22-d7b97d8a21b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.318620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72764-4645-4ca2-8c22-d7b97d8a21b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.318912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72764-4645-4ca2-8c22-d7b97d8a21b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.319308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72764-4645-4ca2-8c22-d7b97d8a21b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.320026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72764-4645-4ca2-8c22-d7b97d8a21b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.321983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72764-4645-4ca2-8c22-d7b97d8a21b2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.452682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 967/1933] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:57 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:57.456954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.466959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb6f0e-7e1a-4fe0-9ed9-511474ddb276 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.522065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.522660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.522940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.523214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.523908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.525837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.631478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798680ff-6eb6-430f-a239-292b4e3a304b None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.632324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798680ff-6eb6-430f-a239-292b4e3a304b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.632638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798680ff-6eb6-430f-a239-292b4e3a304b None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.634032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 968/1934] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:36:57.648001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.656955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.656955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.657176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 967/1935] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:57 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:36:57.657176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.665741 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4dc32-40cc-4df5-b456-45a8edac327d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.670429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.671012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:57.671126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.671358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.671635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.672249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:57.672433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.674141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.679707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:57.690000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 968/1936] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:57.694487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.705789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bad607-409e-40ef-946a-8f038a4e763d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.711139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.711875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.712302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.712753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.713592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.715499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.730769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 969/1937] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:57.732286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.744760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a68cc-87e2-44de-92e5-bf504f1196bd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.755609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969812a-15b2-4961-b3a8-df171642990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.756784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969812a-15b2-4961-b3a8-df171642990c admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.757181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969812a-15b2-4961-b3a8-df171642990c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.757544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969812a-15b2-4961-b3a8-df171642990c admin admin] PATH_INFO: `/v3/projects/7c59f432c5674a3cbef16b5c0e0ac150/users/12e9dcb087424251869e4088aa7bf769/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.764141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 969/1938] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:57.775800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969812a-15b2-4961-b3a8-df171642990c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c59f432c5674a3cbef16b5c0e0ac150, user_id=12e9dcb087424251869e4088aa7bf769, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.775800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5969812a-15b2-4961-b3a8-df171642990c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.776861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.778263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:57.791217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e465b3-a7d9-49e1-9820-4a7f8a46d728 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.796247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.796935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.797215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.797490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.805498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.807046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.817711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 970/1939] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:57.840107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:57.841784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:57.858286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28e567-b0ab-45e3-b804-fd0f14c0ff0a service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:57.866511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:57.867427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.867870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.868301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] PATH_INFO: `/v3/users/aec7846c1b414285b314d686e8c06c16` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.870122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec7846c1b414285b314d686e8c06c16)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:57.875436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:57.877916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 970/1940] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:57 2022] PUT /identity/v3/projects/7c59f432c5674a3cbef16b5c0e0ac150/users/12e9dcb087424251869e4088aa7bf769/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:57.889540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:57.889884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:57.893107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:57.927977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] MFA Rules not processed for user `12e9dcb087424251869e4088aa7bf769`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:57.936751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.006995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 971/1941] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:58.011269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.082406 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb82602-0345-4f8f-92b1-dd8351d52f06 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.087060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.087412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec7846c1b414285b314d686e8c06c16'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.087893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.088179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.088680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.089372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.091270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.101297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec7846c1b414285b314d686e8c06c16'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.102019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec7846c1b414285b314d686e8c06c16'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.108687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec7846c1b414285b314d686e8c06c16'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.154159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 972/1942] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:58 2022] POST /identity/v3/projects => generated 365 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:58.158593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.160240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.181345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec7846c1b414285b314d686e8c06c16'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.188186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 971/1943] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:57 2022] DELETE /identity/v3/users/aec7846c1b414285b314d686e8c06c16 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:58.231354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c30e14-385f-4d1a-9f2d-b8d88be27399 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.279137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:58.301824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.302506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.302795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.303075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.303815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.305806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.420097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 973/1944] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:58 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:58.424276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.435853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1cc76-0f86-44f1-8e86-6497b6845d2f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.440823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.441824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.446220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.446220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.446220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.446848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.450634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.452498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.465202 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 972/1945] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:36:58.465980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.466205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b04cf-48f7-432e-b309-39e7d2dc9832 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.472834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.473720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.474893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.474893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] PATH_INFO: `/v3/projects/de7b05ea6987431d898da3fb1f05b0e6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.475629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7b05ea6987431d898da3fb1f05b0e6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.477876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45e0b1-5431-4d25-9589-4275450873c0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.478211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.482780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.483662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.484009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.484289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] PATH_INFO: `/v3/projects/de3e58e060db4562aa32d891da5b1fef/users/e87721ec1b0e4fbea3de0cf7523d2f08/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.500861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3e58e060db4562aa32d891da5b1fef, user_id=e87721ec1b0e4fbea3de0cf7523d2f08, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.503981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.626381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 973/1946] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:58 2022] PUT /identity/v3/projects/de3e58e060db4562aa32d891da5b1fef/users/e87721ec1b0e4fbea3de0cf7523d2f08/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:58.630449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.633776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7b05ea6987431d898da3fb1f05b0e6', 'request_id': 'req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.640467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7b05ea6987431d898da3fb1f05b0e6', 'request_id': 'req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.692531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f2bcc-0d79-4e15-81c0-dc14a5e6c3fe admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.747701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.748372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.748690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.748970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.749701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.751426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.758862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7b05ea6987431d898da3fb1f05b0e6', 'request_id': 'req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.763683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 974/1947] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:58.769741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.770796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] The token cache is being invalidate because project de7b05ea6987431d898da3fb1f05b0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:36:58.771141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.771832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-49a1fba8-4e2f-41b1-8da7-dcb1d2d4de86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:58.773644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 974/1948] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:36:58 2022] DELETE /identity/v3/projects/de7b05ea6987431d898da3fb1f05b0e6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:58.778453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cc0b-3672-4385-9ddd-b84bf402a11e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.782520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cc0b-3672-4385-9ddd-b84bf402a11e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.782520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7cc0b-3672-4385-9ddd-b84bf402a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.782682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff816a6-e859-4273-982c-6fa40920bdca admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.786066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead35c17-a417-459f-b298-4a83f17103a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.786963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35c17-a417-459f-b298-4a83f17103a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.787242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35c17-a417-459f-b298-4a83f17103a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.787520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead35c17-a417-459f-b298-4a83f17103a3 admin admin] PATH_INFO: `/v3/projects/de3e58e060db4562aa32d891da5b1fef/users/e87721ec1b0e4fbea3de0cf7523d2f08/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.789769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead35c17-a417-459f-b298-4a83f17103a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3e58e060db4562aa32d891da5b1fef, user_id=e87721ec1b0e4fbea3de0cf7523d2f08, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.792448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead35c17-a417-459f-b298-4a83f17103a3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.799723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:58.808119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 975/1949] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:58 2022] PUT /identity/v3/projects/de3e58e060db4562aa32d891da5b1fef/users/e87721ec1b0e4fbea3de0cf7523d2f08/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:36:58.811707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b7f7cc0b-3672-4385-9ddd-b84bf402a11e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:58.813192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b7f7cc0b-3672-4385-9ddd-b84bf402a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.820754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.821046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.821403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.851292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] MFA Rules not processed for user `e87721ec1b0e4fbea3de0cf7523d2f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:58.852578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.880556 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 975/1950] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:58.898516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.898797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.899077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.918133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:58.919352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.926088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 976/1951] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:58.929224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 976/1952] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:36:58.933435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.937898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.939324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:58.943436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5357259-369b-4501-9055-c7bb2f651447 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.948273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.949022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.949306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.949589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.950320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:36:58.950625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.952253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.964158 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 977/1953] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:36:58.968416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:58.975526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:58.978974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc366a2e-e419-401b-914f-1c5fd75fb5f8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:58.983852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:58.985168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:58.985391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:58.985667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:58.986359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:58.988252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:58.999725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f12c69-e333-451a-897b-ef8ee197069c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.003545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.004193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.004478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.004801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.014283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.016237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.025690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 977/1954] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:59.032036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:59.113808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 978/1955] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:58 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:59.121906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.128541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ae74c-c400-40c8-b90e-73d6683d9f2e service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.192711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.193357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.193909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.194187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.194887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.197059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.297428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.299350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:59.315375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 978/1956] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:59 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:59.318386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.329890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba63707-25d8-433f-b2c2-75d04887f9e1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.335122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.336007 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.336369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.336752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.337560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.339263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.350381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 979/1957] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:59.354514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.364888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b7d04-417d-4abb-9827-9785d20565cf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.368111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fad72-82a1-47cb-b478-cbeca0ac1b79 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.370000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.370702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.370932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.371212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.371961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.372075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.372675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.372961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.373233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.373579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.375025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:59.384301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 980/1958] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:36:59.388315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.398398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1da7-95ad-4f23-9346-6e24441ff0de admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.403307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.404173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.404460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.404796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] PATH_INFO: `/v3/projects/a3ae2387201a4234801ba49caa759625/users/d7e9a7fadcdd43e6a7a1f32d6d57b230/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.419651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae2387201a4234801ba49caa759625, user_id=d7e9a7fadcdd43e6a7a1f32d6d57b230, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.422703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.435255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.436708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662a4aa-24ab-48a0-8741-b8b63ac53a34 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.448467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 979/1959] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:36:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:36:59.502584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 981/1960] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:36:59 2022] PUT /identity/v3/projects/a3ae2387201a4234801ba49caa759625/users/d7e9a7fadcdd43e6a7a1f32d6d57b230/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:36:59.513287 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.513580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.513916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.543265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] MFA Rules not processed for user `d7e9a7fadcdd43e6a7a1f32d6d57b230`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:36:59.544783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:59.574726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:36:59.597056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.600184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:36:59.613385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 980/1961] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:36:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:36:59.617776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.664566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9345dc1-9918-4ccc-a902-de045db3ebfa admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.669324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.670398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.670505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.670810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] PATH_INFO: `/v3/users/9ba5bdd8b19c4e8ea0e74a0eda084e19` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.672047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba5bdd8b19c4e8ea0e74a0eda084e19)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.673992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.679415 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c7d6e-1d85-4f07-a35b-978872576168 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.684035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.684841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.685137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.685420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.686107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.688521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.854605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 981/1962] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:36:59 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:36:59.855758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:36:59.916116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9b840-f4ef-4224-8ec9-ef9c37388739 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:36:59.920728 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:36:59.921384 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:36:59.921664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:36:59.921936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:36:59.923128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:36:59.925048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:36:59.949877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba5bdd8b19c4e8ea0e74a0eda084e19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:36:59.950856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba5bdd8b19c4e8ea0e74a0eda084e19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:00.033413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 982/1963] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:36:59 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:00.037572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.046757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25317-ba77-4d92-9c17-8959272704df admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.051859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.052495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.052881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.053161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.053879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.055484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:00.056356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba5bdd8b19c4e8ea0e74a0eda084e19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:00.059016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:00.067149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba5bdd8b19c4e8ea0e74a0eda084e19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:00.067950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-bcdf15c3-9e3b-4479-966d-cbf0f02fb474 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba5bdd8b19c4e8ea0e74a0eda084e19'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:00.071963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 983/1964] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:00.072961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.074746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:00.085677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 982/1965] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:36:59 2022] DELETE /identity/v3/users/9ba5bdd8b19c4e8ea0e74a0eda084e19 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:00.088646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb29f9-b058-4023-b1eb-742def022aa6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.091589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.091881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.092152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.109131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:00.110774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:00.143069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.144249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.144538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.144845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] PATH_INFO: `/v3/projects/353af56568354a69b3c6e353cb9466d9/users/c82581190a044d068aa7fda6c8b086b8/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.159425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353af56568354a69b3c6e353cb9466d9, user_id=c82581190a044d068aa7fda6c8b086b8, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.162108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:00.169006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 983/1966] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:00.179595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.181704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:00.248092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4a71-133b-436f-9e6f-13fb11002a6f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.248092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.248092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.248720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.248720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.258143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.259644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:00.270582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 984/1967] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:00.277758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 984/1968] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:00 2022] PUT /identity/v3/projects/353af56568354a69b3c6e353cb9466d9/users/c82581190a044d068aa7fda6c8b086b8/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:00.281960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.293303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6e1d9-1330-427f-a0c3-8cfe4c59a3c8 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.360319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcf312e-90cf-4a33-8ffc-abdcb583228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.361154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf312e-90cf-4a33-8ffc-abdcb583228e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.361524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf312e-90cf-4a33-8ffc-abdcb583228e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.361809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcf312e-90cf-4a33-8ffc-abdcb583228e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.362578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf312e-90cf-4a33-8ffc-abdcb583228e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.364231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcf312e-90cf-4a33-8ffc-abdcb583228e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:00.374756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 985/1969] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:00.379125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.389565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7a302-a10e-41e9-9656-03c2b41c4637 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.394232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.395109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.395391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.395664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] PATH_INFO: `/v3/projects/353af56568354a69b3c6e353cb9466d9/users/c82581190a044d068aa7fda6c8b086b8/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.397763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] RBAC: Authorizing `identity:create_grant(project_id=353af56568354a69b3c6e353cb9466d9, user_id=c82581190a044d068aa7fda6c8b086b8, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.400427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:00.411989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 985/1970] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:00 2022] PUT /identity/v3/projects/353af56568354a69b3c6e353cb9466d9/users/c82581190a044d068aa7fda6c8b086b8/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:00.424569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.424926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.425194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.429205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:00.462348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] MFA Rules not processed for user `c82581190a044d068aa7fda6c8b086b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:00.463592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:00.530324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 986/1971] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:00.541403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.543089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:00.601669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f446a-eeb1-42e4-9fce-c31234cb873c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.605620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.606325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.606618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.606898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.618501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.619451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:00.629685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 986/1972] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:00.803001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:00.861841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:00.864036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:00.936930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc2633-70eb-4a03-b20f-1c7c06f7e94e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:00.941512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:00.942369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:00.942661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:00.942921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] PATH_INFO: `/v3/projects/54fbd46f89754808bc672a31ef10e93b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:00.944489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fbd46f89754808bc672a31ef10e93b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:00.946538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:01.045841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:01.048137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fbd46f89754808bc672a31ef10e93b', 'request_id': 'req-c80c9b84-1ed8-4625-bed9-93a13922d700'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.057168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fbd46f89754808bc672a31ef10e93b', 'request_id': 'req-c80c9b84-1ed8-4625-bed9-93a13922d700'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.140201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fbd46f89754808bc672a31ef10e93b', 'request_id': 'req-c80c9b84-1ed8-4625-bed9-93a13922d700'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.150896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] The token cache is being invalidate because project 54fbd46f89754808bc672a31ef10e93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:01.151185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.151806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.153400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 987/1973] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:00 2022] DELETE /identity/v3/projects/54fbd46f89754808bc672a31ef10e93b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:01.158248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:01.171326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d0cf-21fb-4715-9cac-88415c6453e2 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:01.239506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:01.240564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:01.240927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:01.241257 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] PATH_INFO: `/v3/users/052686d57a5c49c0a730aeda03cf6e98` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:01.243710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] RBAC: Authorizing `identity:delete_user(user_id=052686d57a5c49c0a730aeda03cf6e98)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:01.246142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:01.300769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:01.485421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052686d57a5c49c0a730aeda03cf6e98'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.497964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052686d57a5c49c0a730aeda03cf6e98'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.498717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052686d57a5c49c0a730aeda03cf6e98'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.504901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:01.529148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052686d57a5c49c0a730aeda03cf6e98'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.681533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ffb121f7-3bc9-42eb-8fb0-b2053fbde97d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052686d57a5c49c0a730aeda03cf6e98'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:01.681533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 987/1974] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:01 2022] DELETE /identity/v3/users/052686d57a5c49c0a730aeda03cf6e98 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:01.815027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:02.090641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:02.166950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.168491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:02.187008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c9b84-1ed8-4625-bed9-93a13922d700 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:02.245123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:02.246008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.246291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.246569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] PATH_INFO: `/v3/projects/55f524e186dd4d6a93033f9b600dd8c7` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.247811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f524e186dd4d6a93033f9b600dd8c7)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:02.249841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:02.363066 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:02.373472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f524e186dd4d6a93033f9b600dd8c7', 'request_id': 'req-88d75992-aa8b-4cc5-8839-094ff29a7415'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:02.380425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f524e186dd4d6a93033f9b600dd8c7', 'request_id': 'req-88d75992-aa8b-4cc5-8839-094ff29a7415'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:02.466210 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f524e186dd4d6a93033f9b600dd8c7', 'request_id': 'req-88d75992-aa8b-4cc5-8839-094ff29a7415'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:02.477563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] The token cache is being invalidate because project 55f524e186dd4d6a93033f9b600dd8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:02.477815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:02.481844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-88d75992-aa8b-4cc5-8839-094ff29a7415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:02.481844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 988/1975] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:02 2022] DELETE /identity/v3/projects/55f524e186dd4d6a93033f9b600dd8c7 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:02.485552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.486026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.486197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.507196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:02.508603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:02.566606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 988/1976] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:02.575879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.576172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.576456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.595571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:02.596787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:02.610172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 989/1977] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:02.611229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.621081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731f5ab-776d-4c97-a368-cb0f775892ef None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:02.626304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:02.626958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.627235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.627503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.628230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:02.628553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:02.630113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:02.634480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:02.645674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 989/1978] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:37:02.649721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.659073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f6dc-8ba4-4d3a-a2cd-b49097a4129b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:02.664802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:02.665654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.666082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.666633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.667047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:02.668996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:02.755682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:02.764527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 990/1979] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:02 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:02.769782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.782051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380753-5979-4813-97a6-4b25e7bf6c80 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:02.840695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:02.841721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.841721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.841893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.842570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:02.844566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:02.917354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 990/1980] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:02 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:02.918380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.929467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211a9fa-693d-4ee5-8bde-61c26072b79d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:02.934132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:02.934786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.935069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.935331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.936052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:02.937654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:02.952635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 991/1981] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:02.953666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.963917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b044c-0c60-4ba8-bc65-ad9bd00b40ff admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:02.968637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab33cb-754d-42aa-b7b1-77ae542afcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:02.969337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab33cb-754d-42aa-b7b1-77ae542afcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:02.969623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab33cb-754d-42aa-b7b1-77ae542afcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:02.969902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab33cb-754d-42aa-b7b1-77ae542afcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:02.970634 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab33cb-754d-42aa-b7b1-77ae542afcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:02.972229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab33cb-754d-42aa-b7b1-77ae542afcf4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:02.982085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 991/1982] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:02.987003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:02.997800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2513b51-71e5-4eec-8d4c-c7ab764ec382 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.003164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.004041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.004325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.004655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] PATH_INFO: `/v3/projects/abd5a76d92e54da692575c22d3a51c2b/users/c7feb3771ccd40edacf23de120beec92/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.019599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd5a76d92e54da692575c22d3a51c2b, user_id=c7feb3771ccd40edacf23de120beec92, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.022418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.098660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 992/1983] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:02 2022] PUT /identity/v3/projects/abd5a76d92e54da692575c22d3a51c2b/users/c7feb3771ccd40edacf23de120beec92/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:03.109031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.109322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.109600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.144217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:03.145635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] MFA Rules not processed for user `c7feb3771ccd40edacf23de120beec92`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:03.146873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:03.223540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.224134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 992/1984] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:03.224225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:03.226124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.275141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:03.290898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7744617-9b82-4cc7-93d8-e8f8cb2a4f1b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.298031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:03.301322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.302312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.302706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.303068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] PATH_INFO: `/v3/users/6c458be558f34554a280573f6a4146f9` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.304490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c458be558f34554a280573f6a4146f9)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.307293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.312813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4510d-239f-4653-953f-94971fe07ea1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.326836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.326836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.326836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.326836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.327449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.327449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.448642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 993/1985] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:03 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:03.451549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.482974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c458be558f34554a280573f6a4146f9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:03.483698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c458be558f34554a280573f6a4146f9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:03.513012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cedce-87db-4b6e-9b01-2edcf212a1f1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.518245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.518941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.519330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.519609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.520293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.522233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.553549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c458be558f34554a280573f6a4146f9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:03.562018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c458be558f34554a280573f6a4146f9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:03.562778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1973f077-a795-4ed2-bd78-77dc064a251d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c458be558f34554a280573f6a4146f9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:03.581892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 993/1986] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:03 2022] DELETE /identity/v3/users/6c458be558f34554a280573f6a4146f9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:03.586559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.587013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.592246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.608040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:03.609260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:03.665884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 994/1987] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:03.675377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.676739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:03.714700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 994/1988] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:03 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:03.715823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.717440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:03.734699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2ae95c-b20b-430a-a078-ddc2a5c1cdbc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.734876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ad65-d5f2-4344-84b8-07fe69d40e57 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.735047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.735827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.745177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.745177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.745177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.745734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.745833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.745906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.745906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.745906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.749078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.749470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 995/1989] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:03.750501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.753571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.763764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 995/1990] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:03.763865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842d063-b6b4-4370-a252-1a14d809ad53 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.768957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.770208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.770208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.770482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] PATH_INFO: `/v3/projects/f68717ccbbdd4327a61eb70a09d5172f/users/cdfd4d58ac6a4a0da2ddd7aeb1437cf1/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.786519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68717ccbbdd4327a61eb70a09d5172f, user_id=cdfd4d58ac6a4a0da2ddd7aeb1437cf1, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.792295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.869678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 996/1991] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:03 2022] PUT /identity/v3/projects/f68717ccbbdd4327a61eb70a09d5172f/users/cdfd4d58ac6a4a0da2ddd7aeb1437cf1/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:03.875420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.885809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f8743-7300-4486-bc4d-ab9845db494f service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.955892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8ae30-b8bb-4400-9087-80c792f30850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.956749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ae30-b8bb-4400-9087-80c792f30850 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.956960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ae30-b8bb-4400-9087-80c792f30850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.957266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8ae30-b8bb-4400-9087-80c792f30850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:03.958045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8ae30-b8bb-4400-9087-80c792f30850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:03.961544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8ae30-b8bb-4400-9087-80c792f30850 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:03.972476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 996/1992] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:03.977079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:03.989553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86b11c-dcc3-4116-9600-b952c43d4d88 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:03.996074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:03.997230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:03.997662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:03.998458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] PATH_INFO: `/v3/projects/f68717ccbbdd4327a61eb70a09d5172f/users/cdfd4d58ac6a4a0da2ddd7aeb1437cf1/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.001264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68717ccbbdd4327a61eb70a09d5172f, user_id=cdfd4d58ac6a4a0da2ddd7aeb1437cf1, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.004251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:04.030892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 997/1993] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:03 2022] PUT /identity/v3/projects/f68717ccbbdd4327a61eb70a09d5172f/users/cdfd4d58ac6a4a0da2ddd7aeb1437cf1/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:04.054370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.055069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.055495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.086629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] MFA Rules not processed for user `cdfd4d58ac6a4a0da2ddd7aeb1437cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:04.087856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.160289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 997/1994] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:04.172400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:04.176593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.212383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:04.214354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.245068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043feb1-d4be-4547-9775-519f7e4511b6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:04.249044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:04.249780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.250066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.250854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.273848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.275832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:04.287641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 998/1995] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:04.288653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:04.290200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.292398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:04.297793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e512412-49a9-4efd-9c0d-47107d24a1ed None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:04.300788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:04.305569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82145b-0adf-4f43-9273-9e5e4a803212 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:04.305677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:04.306555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.306834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.307109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] PATH_INFO: `/v3/users/d7e9a7fadcdd43e6a7a1f32d6d57b230` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.308320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7e9a7fadcdd43e6a7a1f32d6d57b230)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.310424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:04.310825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:04.311762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.312046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.312491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] PATH_INFO: `/v3/projects/ed17af212d874107a18a980bdc5ba8b0` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.314290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed17af212d874107a18a980bdc5ba8b0)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.316175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:04.574171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7e9a7fadcdd43e6a7a1f32d6d57b230'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.575306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7e9a7fadcdd43e6a7a1f32d6d57b230'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.578297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed17af212d874107a18a980bdc5ba8b0', 'request_id': 'req-f7464ff2-2a74-42a0-8e75-ce6c69accd51'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.585301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed17af212d874107a18a980bdc5ba8b0', 'request_id': 'req-f7464ff2-2a74-42a0-8e75-ce6c69accd51'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.591777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed17af212d874107a18a980bdc5ba8b0', 'request_id': 'req-f7464ff2-2a74-42a0-8e75-ce6c69accd51'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.674090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7e9a7fadcdd43e6a7a1f32d6d57b230'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.681636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7e9a7fadcdd43e6a7a1f32d6d57b230'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.685055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0b7585bf-8814-401e-a20a-b25161fb25c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7e9a7fadcdd43e6a7a1f32d6d57b230'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.700508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 998/1996] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:04 2022] DELETE /identity/v3/users/d7e9a7fadcdd43e6a7a1f32d6d57b230 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:04.704830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.705124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.705408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.723068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:04.724279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.785137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] The token cache is being invalidate because project ed17af212d874107a18a980bdc5ba8b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:04.785137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.785137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f7464ff2-2a74-42a0-8e75-ce6c69accd51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:04.785137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 999/1997] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:04 2022] DELETE /identity/v3/projects/ed17af212d874107a18a980bdc5ba8b0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:04.786487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427ca6-60ea-4a55-8286-cf23f9332fbc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.786778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427ca6-60ea-4a55-8286-cf23f9332fbc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.787057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89427ca6-60ea-4a55-8286-cf23f9332fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.793299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 999/1998] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:04.801187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:04.803272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.814445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-89427ca6-60ea-4a55-8286-cf23f9332fbc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:04.815957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-89427ca6-60ea-4a55-8286-cf23f9332fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.826057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1000/1999] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:04.834224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.834703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.834844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.853151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:04.854382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:04.863924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1001/2000] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:04.867662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f306ad78-defe-4061-9563-3261ad9e07ea None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:04.868025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:04.871651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:04.872331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.872761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.873041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.877027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd3817-d42b-4cb6-a52f-b170424e9cd8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:04.881525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:04.882150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.882348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.882456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.882821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.883557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:04.883878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:04.883980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.885521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:04.893982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1000/2001] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:04.897836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1002/2002] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:37:04.902362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:04.913945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fc57-f7fd-48f8-a419-21c603ddf5d5 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:04.919686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:04.920337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:04.920655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:04.921094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:04.921923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:04.930683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.009365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:05.045243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1001/2003] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:04 2022] POST /identity/v3/projects => generated 369 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:05.048992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.058977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c7451-808e-4534-9f8a-a6feb47cbd29 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.128551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.129686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.130623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.131347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.132193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.136196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.234355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1003/2004] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:05 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:05.242332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.255344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd40215-219d-4730-af73-34a7f3741bf5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.262096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.262853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.263203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.263542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.265364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.268161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.281328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1002/2005] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:05.285607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.298817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80733ffd-6b3c-4f75-938b-9ea1ea58a879 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.305309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.306054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.309347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.309347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.309347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.309347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.319865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1004/2006] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:05.324280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.337655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac93dfd-90ea-4891-98ed-5fc205033971 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.341687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0386e-a975-4047-bb48-0d6d9d2b8585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.342704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0386e-a975-4047-bb48-0d6d9d2b8585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.342987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0386e-a975-4047-bb48-0d6d9d2b8585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.343307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0386e-a975-4047-bb48-0d6d9d2b8585 admin admin] PATH_INFO: `/v3/projects/6385e7cf51d6408297156e7e7e4e8259/users/b3b514f5e7a845c498a42d108edebbdc/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.360452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0386e-a975-4047-bb48-0d6d9d2b8585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6385e7cf51d6408297156e7e7e4e8259, user_id=b3b514f5e7a845c498a42d108edebbdc, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.363269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0386e-a975-4047-bb48-0d6d9d2b8585 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.453411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:05.461725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.462199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1003/2007] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:05 2022] PUT /identity/v3/projects/6385e7cf51d6408297156e7e7e4e8259/users/b3b514f5e7a845c498a42d108edebbdc/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:05.464584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:05.474173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.474731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.475152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.481190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f2e96-ef92-4862-bd44-b95017627031 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.514038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] MFA Rules not processed for user `b3b514f5e7a845c498a42d108edebbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:05.515729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:05.527870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:05.547126 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.548006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.548293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.548569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] PATH_INFO: `/v3/projects/a3ae2387201a4234801ba49caa759625` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.549806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ae2387201a4234801ba49caa759625)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.551819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.592871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1004/2008] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:05.593767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.595095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:05.608064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52691a2c-e490-41fa-8b32-91f67b7c22d1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.612840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.613699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.613984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.614263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] PATH_INFO: `/v3/users/c7feb3771ccd40edacf23de120beec92` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.615469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7feb3771ccd40edacf23de120beec92)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.617427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.678760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ae2387201a4234801ba49caa759625', 'request_id': 'req-385a412e-b4ed-407d-9b40-58d063d0a0ef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.684042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ae2387201a4234801ba49caa759625', 'request_id': 'req-385a412e-b4ed-407d-9b40-58d063d0a0ef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.690885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ae2387201a4234801ba49caa759625', 'request_id': 'req-385a412e-b4ed-407d-9b40-58d063d0a0ef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.762565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] The token cache is being invalidate because project a3ae2387201a4234801ba49caa759625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:05.762847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.763498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.765101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1005/2009] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:05 2022] DELETE /identity/v3/projects/a3ae2387201a4234801ba49caa759625 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:05.765851 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.767767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:05.822590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a412e-b4ed-407d-9b40-58d063d0a0ef admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.826109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:05.826739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.827016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.827289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.829038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:05.857115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7feb3771ccd40edacf23de120beec92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.858363 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7feb3771ccd40edacf23de120beec92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.887421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:05.888889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:05.897660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1006/2010] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:05.898437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:05.899729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:05.929148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7feb3771ccd40edacf23de120beec92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.937189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7feb3771ccd40edacf23de120beec92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.937941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0027061e-ec80-48d2-a51d-935e41c112ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7feb3771ccd40edacf23de120beec92'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:05.960164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1005/2011] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:05 2022] DELETE /identity/v3/users/c7feb3771ccd40edacf23de120beec92 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:05.964538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676508ed-8847-479c-80f6-3d667f016081 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:05.965355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676508ed-8847-479c-80f6-3d667f016081 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:05.966334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676508ed-8847-479c-80f6-3d667f016081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:05.968642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec757b6-144e-4159-9384-af9e0cfd92bb service glance] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:05.984364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-676508ed-8847-479c-80f6-3d667f016081 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:05.986318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-676508ed-8847-479c-80f6-3d667f016081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:06.038914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:06.039798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:06.040081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:06.040355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] PATH_INFO: `/v3/users/c82581190a044d068aa7fda6c8b086b8` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:06.041653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82581190a044d068aa7fda6c8b086b8)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:06.043576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:06.054134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1006/2012] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:06.064143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676508ed-8847-479c-80f6-3d667f016081 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:06.066532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-676508ed-8847-479c-80f6-3d667f016081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:06.124522 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676508ed-8847-479c-80f6-3d667f016081 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:06.129083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:06.129726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:06.130003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:06.130278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:06.140771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:06.142233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:06.151806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1007/2013] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:06.234976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82581190a044d068aa7fda6c8b086b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.246999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82581190a044d068aa7fda6c8b086b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.247714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82581190a044d068aa7fda6c8b086b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.255031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82581190a044d068aa7fda6c8b086b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.329236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82581190a044d068aa7fda6c8b086b8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.336159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1007/2014] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:05 2022] DELETE /identity/v3/users/c82581190a044d068aa7fda6c8b086b8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:06.405730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:06.609765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:06.611784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:06.637719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3135088-d65e-404e-88ef-b8381a5a8728 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:06.686014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:06.695923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:06.696875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:06.697175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:06.697444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] PATH_INFO: `/v3/projects/abd5a76d92e54da692575c22d3a51c2b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:06.699030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd5a76d92e54da692575c22d3a51c2b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:06.701241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:06.781107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:06.783214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:06.795943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7d1e0-72d2-4cac-8929-61ae8510fed6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:06.801010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:06.801881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:06.802166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:06.802444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] PATH_INFO: `/v3/users/12e9dcb087424251869e4088aa7bf769` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:06.803827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e9dcb087424251869e4088aa7bf769)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:06.805771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:06.839890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd5a76d92e54da692575c22d3a51c2b', 'request_id': 'req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.846873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd5a76d92e54da692575c22d3a51c2b', 'request_id': 'req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.951699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd5a76d92e54da692575c22d3a51c2b', 'request_id': 'req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.970222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] The token cache is being invalidate because project abd5a76d92e54da692575c22d3a51c2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:06.970514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.971191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:06.973409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1008/2015] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:06 2022] DELETE /identity/v3/projects/abd5a76d92e54da692575c22d3a51c2b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:06.977016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:06.978306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:06.994582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e9dcb087424251869e4088aa7bf769'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.010222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e9dcb087424251869e4088aa7bf769'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.011016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e9dcb087424251869e4088aa7bf769'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.019141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e9dcb087424251869e4088aa7bf769'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.044077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcc2c5-317f-46ad-aedd-9b7d7cadaeef admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.048759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.049621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.049901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.050176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] PATH_INFO: `/v3/projects/353af56568354a69b3c6e353cb9466d9` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.051356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=353af56568354a69b3c6e353cb9466d9)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.053300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.073485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e9dcb087424251869e4088aa7bf769'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.080491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1008/2016] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:06 2022] DELETE /identity/v3/users/12e9dcb087424251869e4088aa7bf769 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:07.081327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.082685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:07.148926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b239c1-1974-4b34-8ba5-255ed6b4ba53 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.155105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353af56568354a69b3c6e353cb9466d9', 'request_id': 'req-24a3b424-efd1-4b54-a6ba-52f2b42becfc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.162671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353af56568354a69b3c6e353cb9466d9', 'request_id': 'req-24a3b424-efd1-4b54-a6ba-52f2b42becfc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.207779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.208702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.208986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.209378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] PATH_INFO: `/v3/users/cdfd4d58ac6a4a0da2ddd7aeb1437cf1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.210580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdfd4d58ac6a4a0da2ddd7aeb1437cf1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.212883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.248890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353af56568354a69b3c6e353cb9466d9', 'request_id': 'req-24a3b424-efd1-4b54-a6ba-52f2b42becfc'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.261343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] The token cache is being invalidate because project 353af56568354a69b3c6e353cb9466d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:07.261709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.262461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-24a3b424-efd1-4b54-a6ba-52f2b42becfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.264135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1009/2017] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:06 2022] DELETE /identity/v3/projects/353af56568354a69b3c6e353cb9466d9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:07.265526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8e83-9db3-470a-9f82-7da6320d4e8a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.265825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8e83-9db3-470a-9f82-7da6320d4e8a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.266106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8e83-9db3-470a-9f82-7da6320d4e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.285684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8d0a8e83-9db3-470a-9f82-7da6320d4e8a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:07.286882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8d0a8e83-9db3-470a-9f82-7da6320d4e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:07.294617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1010/2018] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:07.295845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.296136 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.296415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.316304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:07.317542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:07.325960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1011/2019] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:07.326776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.328057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:07.383934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bbce5-e439-4221-ab7c-8155c30c9581 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.388145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167279ef-370e-4ec0-80ff-59bc1587e40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.388773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167279ef-370e-4ec0-80ff-59bc1587e40d service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.389062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167279ef-370e-4ec0-80ff-59bc1587e40d service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.389356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167279ef-370e-4ec0-80ff-59bc1587e40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.400663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167279ef-370e-4ec0-80ff-59bc1587e40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.400956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167279ef-370e-4ec0-80ff-59bc1587e40d service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.404238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdfd4d58ac6a4a0da2ddd7aeb1437cf1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.411058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1012/2020] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:07.412489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.412814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.413096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.425371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdfd4d58ac6a4a0da2ddd7aeb1437cf1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.426402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdfd4d58ac6a4a0da2ddd7aeb1437cf1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.433287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:07.433287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:07.439553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdfd4d58ac6a4a0da2ddd7aeb1437cf1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.442401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1013/2021] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:07.447226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.456526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9033f5-76e6-4631-9774-a4d1a72e6c00 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.461441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.462141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.462412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.462691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.463417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:07.463726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.465351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.477428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1014/2022] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:37:07.481975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.486308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdfd4d58ac6a4a0da2ddd7aeb1437cf1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:07.493701 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1009/2023] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:07 2022] DELETE /identity/v3/users/cdfd4d58ac6a4a0da2ddd7aeb1437cf1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:07.495805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbb13-0248-4d59-a538-1ad541c8c709 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.559456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.560304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.560693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.560973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.567904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.570545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.674005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1015/2024] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:07 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:07.674994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.687305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c753e-b839-4d36-a986-9e1dd88caca1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.748500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.748949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:07.749632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.750320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.750552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.752222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.754338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.861823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1010/2025] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:07 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:07.866059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.878255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d2fab-91c1-42f8-8cc0-90a28bfbbc8d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.883712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.884458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.884811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.885545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.885945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.887502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.901500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1016/2026] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:07.905609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.918551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e6da1-7be4-4d4d-a5e4-11210842a9f2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.924112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.924897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.925186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.925467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.926205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.927806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.937884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.940642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:07.942672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1011/2027] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:07.943627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:07.960684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0ff0a-4a7b-4df6-9ea3-6e120129ff7a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.964988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82844f-be4d-4c73-90f5-290cc1a7160f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:07.968857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a6873-21b1-4384-a652-2ce4c1d54403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.970460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:07.970926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a6873-21b1-4384-a652-2ce4c1d54403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.971323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:07.971875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a6873-21b1-4384-a652-2ce4c1d54403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.971986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:07.972125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] PATH_INFO: `/v3/projects/7c59f432c5674a3cbef16b5c0e0ac150` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.972389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a6873-21b1-4384-a652-2ce4c1d54403 admin admin] PATH_INFO: `/v3/projects/7a7555083d0343eeb908a73d90c89706/users/59852bc75ffc43e6b70e68541f8b6a25/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:07.973935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c59f432c5674a3cbef16b5c0e0ac150)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.977024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:07.991265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a6873-21b1-4384-a652-2ce4c1d54403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a7555083d0343eeb908a73d90c89706, user_id=59852bc75ffc43e6b70e68541f8b6a25, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:07.994155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a6873-21b1-4384-a652-2ce4c1d54403 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.038122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:08.072810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1012/2028] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:07 2022] PUT /identity/v3/projects/7a7555083d0343eeb908a73d90c89706/users/59852bc75ffc43e6b70e68541f8b6a25/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:08.084746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.085047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.085328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.113012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c59f432c5674a3cbef16b5c0e0ac150', 'request_id': 'req-a26329fe-adc8-49b9-b55b-c3c362abad25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.113231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] MFA Rules not processed for user `59852bc75ffc43e6b70e68541f8b6a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:08.114281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.120836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c59f432c5674a3cbef16b5c0e0ac150', 'request_id': 'req-a26329fe-adc8-49b9-b55b-c3c362abad25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.184763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1013/2029] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:08.188303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.188303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.197457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c59f432c5674a3cbef16b5c0e0ac150', 'request_id': 'req-a26329fe-adc8-49b9-b55b-c3c362abad25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.210061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] The token cache is being invalidate because project 7c59f432c5674a3cbef16b5c0e0ac150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:08.210351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.211000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.212807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1017/2030] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:07 2022] DELETE /identity/v3/projects/7c59f432c5674a3cbef16b5c0e0ac150 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:08.213315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.214771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.254363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e317694-b37f-4230-8d5c-8e83b88d55ae None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.260534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.261574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.261967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.262309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] PATH_INFO: `/v3/projects/f68717ccbbdd4327a61eb70a09d5172f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.263566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68717ccbbdd4327a61eb70a09d5172f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.265494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.285126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26329fe-adc8-49b9-b55b-c3c362abad25 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.289818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.290639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.290911 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.291190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.291896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.293842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.394632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1018/2031] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:08 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:08.395290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.397097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.397281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68717ccbbdd4327a61eb70a09d5172f', 'request_id': 'req-65445738-7910-4b66-b770-937e946e50fb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.402691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68717ccbbdd4327a61eb70a09d5172f', 'request_id': 'req-65445738-7910-4b66-b770-937e946e50fb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.409130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68717ccbbdd4327a61eb70a09d5172f', 'request_id': 'req-65445738-7910-4b66-b770-937e946e50fb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.459214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c115e-7480-4154-9baf-480a5ab92c08 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.462030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] The token cache is being invalidate because project f68717ccbbdd4327a61eb70a09d5172f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:08.462547 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.463604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.464056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.465148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.465259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.465513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] PATH_INFO: `/v3/users/e87721ec1b0e4fbea3de0cf7523d2f08` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.468022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87721ec1b0e4fbea3de0cf7523d2f08)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.471829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1014/2032] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:08 2022] DELETE /identity/v3/projects/f68717ccbbdd4327a61eb70a09d5172f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:08.471829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.472215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.472305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.535793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65445738-7910-4b66-b770-937e946e50fb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.540695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a5602-2e80-4f1b-9151-b466f75ea279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.541372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5602-2e80-4f1b-9151-b466f75ea279 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.541673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5602-2e80-4f1b-9151-b466f75ea279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.541954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a5602-2e80-4f1b-9151-b466f75ea279 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.542650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a5602-2e80-4f1b-9151-b466f75ea279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.544862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a5602-2e80-4f1b-9151-b466f75ea279 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.646774 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87721ec1b0e4fbea3de0cf7523d2f08'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.647507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87721ec1b0e4fbea3de0cf7523d2f08'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.660811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:08.666901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1015/2033] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:08 2022] POST /identity/v3/users => generated 299 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:08.668165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.668445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.669073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.691044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:08.692854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.700656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1016/2034] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:08.702216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.711989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87721ec1b0e4fbea3de0cf7523d2f08'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.712484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3cde7e-288c-4b6b-9d69-9a131d42cb71 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.717180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa67e85-9d66-4a86-9240-bc7b43280034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.717833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa67e85-9d66-4a86-9240-bc7b43280034 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.718124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa67e85-9d66-4a86-9240-bc7b43280034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.718401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa67e85-9d66-4a86-9240-bc7b43280034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.719134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa67e85-9d66-4a86-9240-bc7b43280034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.721687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87721ec1b0e4fbea3de0cf7523d2f08'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.721687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87721ec1b0e4fbea3de0cf7523d2f08'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:08.721993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa67e85-9d66-4a86-9240-bc7b43280034 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.732376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1017/2035] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:08.732376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.732376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.732376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.739993 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1019/2036] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:08 2022] DELETE /identity/v3/users/e87721ec1b0e4fbea3de0cf7523d2f08 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:08.740851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.742219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.755942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:08.757325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:08.822326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38032c-e975-4f84-a0fb-6cc14201ab78 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.830154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.831064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.831347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.831817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] PATH_INFO: `/v3/projects/20abd41813144d449589faa0bd9f1deb/users/5d576e6cc92641d69401b36f4abb9145/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.850463 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20abd41813144d449589faa0bd9f1deb, user_id=5d576e6cc92641d69401b36f4abb9145, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.857516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.863306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1018/2037] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:08.864802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.878799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093aaa12-a459-43fd-86e7-d5a64c13c70d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.894387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.894387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.894387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.894387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.894727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:08.894727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.894727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.909167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1019/2038] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:37:08.910295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:08.920990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134461dd-eca8-476c-ba5c-1291729fe4c5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:08.926795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:08.929416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:08.929416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:08.929416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:08.929416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:08.930600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:08.954049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1020/2039] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:08 2022] PUT /identity/v3/projects/20abd41813144d449589faa0bd9f1deb/users/5d576e6cc92641d69401b36f4abb9145/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:08.963277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.022595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1020/2040] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:08 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:09.023689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.038018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9244ca-c0de-432b-8764-30dabef56034 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.099670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7f805-b5a8-4203-9c55-c2bbd9f2bb95 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.104671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.104820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.105324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.106079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.106212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.106303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.106401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.106489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.106621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.107237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.108447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.113219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.122026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1021/2041] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:09.129190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.139415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f1b16-57db-4904-8b32-f261fe15c349 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.144567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2b87-f0e4-432c-9802-adefb5e5c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.145526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2b87-f0e4-432c-9802-adefb5e5c488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.145803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2b87-f0e4-432c-9802-adefb5e5c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.146143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2b87-f0e4-432c-9802-adefb5e5c488 admin admin] PATH_INFO: `/v3/projects/20abd41813144d449589faa0bd9f1deb/users/5d576e6cc92641d69401b36f4abb9145/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.148093 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2b87-f0e4-432c-9802-adefb5e5c488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20abd41813144d449589faa0bd9f1deb, user_id=5d576e6cc92641d69401b36f4abb9145, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.151000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2b87-f0e4-432c-9802-adefb5e5c488 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.162604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1022/2042] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:09 2022] PUT /identity/v3/projects/20abd41813144d449589faa0bd9f1deb/users/5d576e6cc92641d69401b36f4abb9145/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:09.172538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.173660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.173943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.200192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] MFA Rules not processed for user `5d576e6cc92641d69401b36f4abb9145`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:09.201478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.228256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1021/2043] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:09.232145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.242997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3740cf-f29b-4c5b-858e-c2e506003177 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.289692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1023/2044] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:09.291050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.292517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.329878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.330553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.330853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.331120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.331855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.333530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.343473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1022/2045] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:09.344268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.346530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.358706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44c176-e7c5-486f-9cab-4890ea9c0e00 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.364964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.365872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.366139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.366416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] PATH_INFO: `/v3/projects/de3e58e060db4562aa32d891da5b1fef` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.367831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3e58e060db4562aa32d891da5b1fef)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.370072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.409243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77f95-6d0a-47cd-b439-87a783c8a255 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.412971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.413558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.413842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.414120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.422873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:09.425628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.430805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.436577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1023/2046] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:09.437484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.449942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42dafd9-8639-4fa6-b4c2-fcf7ef927f70 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.455282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.455931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.456171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.461371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.461371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.461371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.471510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1024/2047] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:09.475564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.476728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3e58e060db4562aa32d891da5b1fef', 'request_id': 'req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.483694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3e58e060db4562aa32d891da5b1fef', 'request_id': 'req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.489387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8bab1-66fd-411c-998e-3dc6cb9d24a7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.547557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fc67d-8dd8-4a59-bb38-991090b03bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.548518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fc67d-8dd8-4a59-bb38-991090b03bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.548832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fc67d-8dd8-4a59-bb38-991090b03bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.549397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fc67d-8dd8-4a59-bb38-991090b03bd2 admin admin] PATH_INFO: `/v3/projects/6444ab116766476ebe2be37ae0b95c1c/users/0aa741cb2cb7429db7d4042b7b37cfff/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.565406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fc67d-8dd8-4a59-bb38-991090b03bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6444ab116766476ebe2be37ae0b95c1c, user_id=0aa741cb2cb7429db7d4042b7b37cfff, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.568116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fc67d-8dd8-4a59-bb38-991090b03bd2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.576333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3e58e060db4562aa32d891da5b1fef', 'request_id': 'req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.588000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] The token cache is being invalidate because project de3e58e060db4562aa32d891da5b1fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:09.588322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.589048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.590646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1024/2048] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:09 2022] DELETE /identity/v3/projects/de3e58e060db4562aa32d891da5b1fef => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:09.591546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.592890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.606214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dc48f-a6c2-4bac-9e11-c5b2422dec52 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.611602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.612475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.612806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.613086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] PATH_INFO: `/v3/users/59852bc75ffc43e6b70e68541f8b6a25` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.614407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59852bc75ffc43e6b70e68541f8b6a25)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.616823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.673931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1025/2049] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:09 2022] PUT /identity/v3/projects/6444ab116766476ebe2be37ae0b95c1c/users/0aa741cb2cb7429db7d4042b7b37cfff/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:09.675369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ce3d-78c9-40cd-ad7d-b2d96dfe2b1c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.675659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ce3d-78c9-40cd-ad7d-b2d96dfe2b1c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.676191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86ce3d-78c9-40cd-ad7d-b2d96dfe2b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.695976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0f86ce3d-78c9-40cd-ad7d-b2d96dfe2b1c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:09.697198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0f86ce3d-78c9-40cd-ad7d-b2d96dfe2b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.755880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1026/2050] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:09.757174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e1987-e730-41d6-8fa7-54aacb76c829 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.757466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e1987-e730-41d6-8fa7-54aacb76c829 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.757856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e1987-e730-41d6-8fa7-54aacb76c829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.758526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:09.775330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-557e1987-e730-41d6-8fa7-54aacb76c829 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:09.776522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-557e1987-e730-41d6-8fa7-54aacb76c829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.784190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1027/2051] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:09.785405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.785687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.785958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.809415 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:09.810694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.815188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59852bc75ffc43e6b70e68541f8b6a25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.815819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59852bc75ffc43e6b70e68541f8b6a25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.819529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1028/2052] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:09.822985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.822985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.876667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7b04e-1919-432a-8a2a-ca8f2b1b5031 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.880432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.881118 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.881410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.881682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.891250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.892738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.900863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59852bc75ffc43e6b70e68541f8b6a25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.904748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1029/2053] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:09.904748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.909428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59852bc75ffc43e6b70e68541f8b6a25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.910396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3ae1a68c-f356-4512-b1f8-cad0e8d16300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59852bc75ffc43e6b70e68541f8b6a25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:09.914071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32609d-30c5-4a96-8981-44913d9f1d34 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.920289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:09.920984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.921275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.921643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.922325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:09.922836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:09.925293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:09.937233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1025/2054] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:09 2022] DELETE /identity/v3/users/59852bc75ffc43e6b70e68541f8b6a25 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:09.942863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1030/2055] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:37:09.943172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:09.943172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:09.943172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:09.944529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:09.946794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:09.959586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63d35c-2de7-4c47-b6dd-20c664c88b7a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:09.977292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:09.978523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:10.030234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.030914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.031201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.031480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.036107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.036107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.040502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:10.055211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1026/2056] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:10.067325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.069098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:10.136707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3260e1-6729-459e-8622-1bcfc6e15214 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.140952 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.145856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.145856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.145856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.146219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1031/2057] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:09 2022] POST /identity/v3/projects => generated 361 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:10.150111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.156508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.158681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.168421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1027/2058] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:10.198740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:10.222838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02285a97-9dab-48c1-8380-df2d14ecdab4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.227768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.228438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.228770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.229055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.229757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.231684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.306628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1032/2059] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:10 2022] POST /identity/v3/users => generated 281 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:10.307862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.318967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30907e7e-31b8-4c5d-afb2-3041dc400e2c service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.324315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.325102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.329770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.329770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.329770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.329770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.342477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1028/2060] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:10.343774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.358946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb054a-bcd6-4e92-989d-0261fd624914 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.364691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a704a9e-4e38-4e58-a6ce-95fad0e06694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.365365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a704a9e-4e38-4e58-a6ce-95fad0e06694 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.365654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a704a9e-4e38-4e58-a6ce-95fad0e06694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.365931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a704a9e-4e38-4e58-a6ce-95fad0e06694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.366672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a704a9e-4e38-4e58-a6ce-95fad0e06694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.368272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a704a9e-4e38-4e58-a6ce-95fad0e06694 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.378819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1033/2061] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:10.383283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.394010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fc219-ad51-4ef0-9fe4-eebdffe63a60 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.399451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.400384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.400712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.401324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] PATH_INFO: `/v3/projects/c784438ee6a84aefa7a0ed079c01ec60/users/9940732bd48d4f1f934ce0ed860d03d0/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.416932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c784438ee6a84aefa7a0ed079c01ec60, user_id=9940732bd48d4f1f934ce0ed860d03d0, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.419568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.512135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1029/2062] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:10 2022] PUT /identity/v3/projects/c784438ee6a84aefa7a0ed079c01ec60/users/9940732bd48d4f1f934ce0ed860d03d0/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:10.527174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.527341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.527641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.531536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:10.564163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] MFA Rules not processed for user `9940732bd48d4f1f934ce0ed860d03d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:10.565458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:10.658401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1034/2063] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:10.693614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.695727 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:10.758744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e9521-90d0-45ca-babd-5f6182763ff7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.762678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.763319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.763607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.763884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.773193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.774624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.778599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.780083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:10.784578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1030/2064] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:10.799875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:10.865409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd059c-24e0-4fb0-9126-408ab34238df None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.871242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce090-7eb1-475d-9f3c-39daf954927e service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:10.876977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.877866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.878152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.878465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] PATH_INFO: `/v3/projects/7a7555083d0343eeb908a73d90c89706` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.884278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:10.884451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a7555083d0343eeb908a73d90c89706)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.884553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:10.884553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:10.884553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] PATH_INFO: `/v3/users/9940732bd48d4f1f934ce0ed860d03d0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:10.884830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.884919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9940732bd48d4f1f934ce0ed860d03d0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:10.885300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:10.906110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:11.087063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a7555083d0343eeb908a73d90c89706', 'request_id': 'req-30ea4f72-514e-4866-952d-7a786d39fb74'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.093301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a7555083d0343eeb908a73d90c89706', 'request_id': 'req-30ea4f72-514e-4866-952d-7a786d39fb74'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.099552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9940732bd48d4f1f934ce0ed860d03d0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.105079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9940732bd48d4f1f934ce0ed860d03d0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.107318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a7555083d0343eeb908a73d90c89706', 'request_id': 'req-30ea4f72-514e-4866-952d-7a786d39fb74'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.147825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9940732bd48d4f1f934ce0ed860d03d0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.155170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9940732bd48d4f1f934ce0ed860d03d0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.155797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6ba518c9-041f-4234-b7ff-40ce87126844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9940732bd48d4f1f934ce0ed860d03d0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.175505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1031/2065] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:10 2022] DELETE /identity/v3/users/9940732bd48d4f1f934ce0ed860d03d0 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:11.179925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.180207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.180514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.199204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:11.200420 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.220241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] The token cache is being invalidate because project 7a7555083d0343eeb908a73d90c89706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:11.220522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.221347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.223110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1035/2066] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:10 2022] DELETE /identity/v3/projects/7a7555083d0343eeb908a73d90c89706 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:11.227179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.229007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.269557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1032/2067] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:11.279980 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.282545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.325572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea4f72-514e-4866-952d-7a786d39fb74 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.331684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.336582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.336965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.337269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] PATH_INFO: `/v3/users/5d576e6cc92641d69401b36f4abb9145` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.338669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d576e6cc92641d69401b36f4abb9145)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.341175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.369265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e69e5-afb3-4210-8094-bc3b4c9a5bab None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.372153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab25a22-4fae-4742-ae3b-81be50f2ae10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.372961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25a22-4fae-4742-ae3b-81be50f2ae10 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.373321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25a22-4fae-4742-ae3b-81be50f2ae10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.373678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab25a22-4fae-4742-ae3b-81be50f2ae10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.384758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab25a22-4fae-4742-ae3b-81be50f2ae10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.386259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab25a22-4fae-4742-ae3b-81be50f2ae10 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.396480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1033/2068] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:11.397688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.398044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.398379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.431862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] MFA Rules not processed for user `0aa741cb2cb7429db7d4042b7b37cfff`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:11.433165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.470708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:11.510765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1034/2069] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:11.515103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.516424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.529563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c4664-9aeb-4f17-95e9-cee131e626c1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.534554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.535203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.535488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.535766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.536494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.538433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.562927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d576e6cc92641d69401b36f4abb9145'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.566044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:11.580411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d576e6cc92641d69401b36f4abb9145'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.582289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d576e6cc92641d69401b36f4abb9145'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.590260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d576e6cc92641d69401b36f4abb9145'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.677703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1035/2070] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:11 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:11.681465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.683117 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.697424 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d576e6cc92641d69401b36f4abb9145'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.704606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1036/2071] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:11 2022] DELETE /identity/v3/users/5d576e6cc92641d69401b36f4abb9145 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:11.750319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3625-f38d-4a89-9450-7492e9c5b1d4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.807510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.808194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.808483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.808794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.809479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.811360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.832425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.833901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:11.848128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c472b-f1da-428c-8534-8801502f1551 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.853236 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.856522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.856522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.856522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] PATH_INFO: `/v3/projects/c784438ee6a84aefa7a0ed079c01ec60` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.858937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c784438ee6a84aefa7a0ed079c01ec60)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.861510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.901031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1036/2072] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:11 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:11.902197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.913039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb27d-ffdb-45f8-8122-19fb5aacfaf0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.917878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.918536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.921292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.921292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.921292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.921635 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.931691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1037/2073] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:11.935803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:11.946077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa81acc-7623-4a5c-9815-be1fdc72cb9f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:11.950752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:11.951638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:11.951921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:11.952220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] PATH_INFO: `/v3/projects/4b1e6f0eab7c4fdaa5b4f8362ce7ba48/users/b6ce288a0e29404384882089e4eae16e/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:11.969060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1e6f0eab7c4fdaa5b4f8362ce7ba48, user_id=b6ce288a0e29404384882089e4eae16e, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:11.973125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:11.984268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:11.985315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c784438ee6a84aefa7a0ed079c01ec60', 'request_id': 'req-675eadb1-b8b5-468b-acce-a69f97a99aef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.991238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c784438ee6a84aefa7a0ed079c01ec60', 'request_id': 'req-675eadb1-b8b5-468b-acce-a69f97a99aef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:11.999559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c784438ee6a84aefa7a0ed079c01ec60', 'request_id': 'req-675eadb1-b8b5-468b-acce-a69f97a99aef'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.054374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1038/2074] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:11 2022] PUT /identity/v3/projects/4b1e6f0eab7c4fdaa5b4f8362ce7ba48/users/b6ce288a0e29404384882089e4eae16e/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:12.055569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.074394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] The token cache is being invalidate because project c784438ee6a84aefa7a0ed079c01ec60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:12.074802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.075739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-675eadb1-b8b5-468b-acce-a69f97a99aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.081753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1037/2075] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:11 2022] DELETE /identity/v3/projects/c784438ee6a84aefa7a0ed079c01ec60 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:12.083332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd53a4-c977-4213-9f88-eacfcc051ea0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.083688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd53a4-c977-4213-9f88-eacfcc051ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.084035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd53a4-c977-4213-9f88-eacfcc051ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.106371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-19fd53a4-c977-4213-9f88-eacfcc051ea0 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:12.107605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-19fd53a4-c977-4213-9f88-eacfcc051ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.136734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a2334-0aa8-4b3c-887c-9213970ea6c8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.147470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.148182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.148476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.148799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.149539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.151263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.164645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1039/2076] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:12.165859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.167789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.173856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1038/2077] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:12.180498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a97328-2ce6-4fe6-a992-41a9049a9a2b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.181941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.182228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.184361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.185201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.186081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.186358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.186629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] PATH_INFO: `/v3/projects/4b1e6f0eab7c4fdaa5b4f8362ce7ba48/users/b6ce288a0e29404384882089e4eae16e/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.189338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1e6f0eab7c4fdaa5b4f8362ce7ba48, user_id=b6ce288a0e29404384882089e4eae16e, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.191954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.202008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:12.203215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.208513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1040/2078] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:12 2022] PUT /identity/v3/projects/4b1e6f0eab7c4fdaa5b4f8362ce7ba48/users/b6ce288a0e29404384882089e4eae16e/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:12.219419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.222392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.283668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1039/2079] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:12.287674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.297643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f3ee0-81bc-4f0c-b8e5-12c207247f59 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.297869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:12.302595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.303232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.303507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.303831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.305121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:12.305521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.307454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.324670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1040/2080] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:37:12.329168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.338837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52728de3-d021-49ac-a142-13fbf4bfd152 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.351347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.351532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf07590-4a64-4da5-9a7e-a28a9a254d78 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.351630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.351630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.351630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] PATH_INFO: `/v3/projects/20abd41813144d449589faa0bd9f1deb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.351630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20abd41813144d449589faa0bd9f1deb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.355083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.356819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.357909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.358456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.359090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.360358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.365442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.399760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:12.494010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1041/2081] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/projects => generated 375 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:12.498335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.576716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20abd41813144d449589faa0bd9f1deb', 'request_id': 'req-5403bb30-5fce-4478-a122-307adfcce6b4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.584457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20abd41813144d449589faa0bd9f1deb', 'request_id': 'req-5403bb30-5fce-4478-a122-307adfcce6b4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.593878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f834ca-3d45-49f1-b253-4b4028912fea admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.659825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.660521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.660943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.661222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.661922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.663884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.724916 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20abd41813144d449589faa0bd9f1deb', 'request_id': 'req-5403bb30-5fce-4478-a122-307adfcce6b4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.734095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] The token cache is being invalidate because project 20abd41813144d449589faa0bd9f1deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:12.734460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.735145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-5403bb30-5fce-4478-a122-307adfcce6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:12.737384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1041/2082] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:12 2022] DELETE /identity/v3/projects/20abd41813144d449589faa0bd9f1deb => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:12.743305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b6a24-f89d-46d1-9d30-f546fea61956 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.746411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b6a24-f89d-46d1-9d30-f546fea61956 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.746411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b6a24-f89d-46d1-9d30-f546fea61956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.769533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7a9b6a24-f89d-46d1-9d30-f546fea61956 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:12.770746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7a9b6a24-f89d-46d1-9d30-f546fea61956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.773721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1042/2083] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:12.779163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.780372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1042/2084] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:12.781589 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.790062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.790377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.790655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.795027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed25f6-aac9-48a5-b300-ca66d7a7870d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.800886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.801830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.802289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.802872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.803818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.805699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.819592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1043/2085] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:12.819769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:12.819769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:12.820957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.828207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1043/2086] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:12.830901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529589c-dfc9-483d-bd2f-ee2bcb6fc363 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.832206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.835990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.836541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.836865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.837133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.837982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.839519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.847638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240adecc-8437-4941-9194-8eb221dc54ed None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.852416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1044/2087] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:12.853682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.854334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.854617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.854893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.856722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:12.856722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.857868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.858612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.869214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b39bfc-53d5-48bc-b672-499933bf7b82 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.873615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1044/2088] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:37:12.874545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:12.878195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.879320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.879667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.880022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] PATH_INFO: `/v3/projects/6d5096b428034c649f5da60f0f182293/users/b2f3ed0d7cd849d1ba2647711c461881/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.885817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc51af-23a7-4aa3-8b51-a4b47b29f391 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:12.892306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f6668-fe69-472e-a722-bbf5348962c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:12.893178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f6668-fe69-472e-a722-bbf5348962c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:12.893528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f6668-fe69-472e-a722-bbf5348962c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:12.893900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f6668-fe69-472e-a722-bbf5348962c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:12.894753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f6668-fe69-472e-a722-bbf5348962c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.899717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f6668-fe69-472e-a722-bbf5348962c8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.903769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5096b428034c649f5da60f0f182293, user_id=b2f3ed0d7cd849d1ba2647711c461881, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:12.907272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:12.970806 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:13.005176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1045/2089] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:12 2022] PUT /identity/v3/projects/6d5096b428034c649f5da60f0f182293/users/b2f3ed0d7cd849d1ba2647711c461881/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:13.009615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1045/2090] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:12 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:13.010920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:13.016598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.017140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.017482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.055797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] MFA Rules not processed for user `b2f3ed0d7cd849d1ba2647711c461881`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:13.056970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:13.072874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:13.100275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb98153-0d53-4de0-a69d-36c1175c7d02 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:13.161100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1046/2091] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:13.166775 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:13.167104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.167462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.167825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.168579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:13.192715 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:13.193141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:13.193141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:13.243066 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375310-4c7c-4c91-914d-53d2a7442e60 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:13.246920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:13.247587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.247856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.248151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.257095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:13.258510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:13.268922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1047/2092] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:13.297778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1046/2093] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:13 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:13.301800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:13.313371 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8149f9-f6e1-4188-b1ee-d022c0739dfa service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:13.318068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:13.318759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.319457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.319457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.320300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:13.321957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:13.334804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1048/2094] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:13.338469 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:13.351195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65b68-9746-4d0e-b893-24ad46ddf165 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:13.355891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e714039-0161-48c5-8869-522ebb961c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:13.356543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714039-0161-48c5-8869-522ebb961c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.356867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714039-0161-48c5-8869-522ebb961c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.357141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e714039-0161-48c5-8869-522ebb961c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.357869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e714039-0161-48c5-8869-522ebb961c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:13.359485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e714039-0161-48c5-8869-522ebb961c59 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:13.373635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1047/2095] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:13.380362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:13.396826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88e7a-96b0-46e1-9d1b-5b6ddc9a2640 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:13.402205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:13.403260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.406283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.406283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] PATH_INFO: `/v3/projects/28b71cc5bc7c46a49d6413d16b32e836/users/f5b10a41133c45ee8868d2fae9d382ec/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.421350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b71cc5bc7c46a49d6413d16b32e836, user_id=f5b10a41133c45ee8868d2fae9d382ec, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:13.424042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:13.503015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1049/2096] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:13 2022] PUT /identity/v3/projects/28b71cc5bc7c46a49d6413d16b32e836/users/f5b10a41133c45ee8868d2fae9d382ec/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:13.514162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57327a1f-1246-4c28-a954-cd358d4abf32 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.514455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57327a1f-1246-4c28-a954-cd358d4abf32 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.514759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57327a1f-1246-4c28-a954-cd358d4abf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.542302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-57327a1f-1246-4c28-a954-cd358d4abf32 None None] MFA Rules not processed for user `f5b10a41133c45ee8868d2fae9d382ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:13.543502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-57327a1f-1246-4c28-a954-cd358d4abf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:13.611858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1048/2097] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:13.622973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:13.624820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:13.670493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:13.700573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1131f9-ae06-446b-9f47-db22b3aed73f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:13.704227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57a398-9f96-4a78-8d30-e02f8ea4e57f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:13.705519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57a398-9f96-4a78-8d30-e02f8ea4e57f service glance] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:13.705795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57a398-9f96-4a78-8d30-e02f8ea4e57f service glance] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:13.706072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57a398-9f96-4a78-8d30-e02f8ea4e57f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:13.714875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57a398-9f96-4a78-8d30-e02f8ea4e57f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:13.716409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57a398-9f96-4a78-8d30-e02f8ea4e57f service glance] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:13.722630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:13.727355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1050/2098] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:14.120720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:14.122065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:14.122647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:14.168216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] MFA Rules not processed for user `b6ce288a0e29404384882089e4eae16e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:14.169472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:14.258182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1049/2099] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:14.269491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:14.269491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:14.269715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:14.289783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] MFA Rules not processed for user `0aa741cb2cb7429db7d4042b7b37cfff`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:14.291001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:14.301658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:14.355695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1051/2100] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:14.358666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:14.367641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:14.368961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:14.446684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d33154-dc81-4216-8c6b-7972adf80fb2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:14.452362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:14.453066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:14.453352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:14.453627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:14.455450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:14.466094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:14.467667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f34b24e-b501-48dc-92e5-0962bfa9e784 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:14.476890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1050/2101] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:14.890691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:15.063030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:24.959262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:24.994524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:25.022666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438607e-5f1b-4652-a817-91e5950273cf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:25.027383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:25.031342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:25.031342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:25.031342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] PATH_INFO: `/v3/users/b2f3ed0d7cd849d1ba2647711c461881` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:25.031342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f3ed0d7cd849d1ba2647711c461881)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:25.032737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:25.207968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f3ed0d7cd849d1ba2647711c461881'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:25.208645 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f3ed0d7cd849d1ba2647711c461881'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:25.284888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f3ed0d7cd849d1ba2647711c461881'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:25.293018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f3ed0d7cd849d1ba2647711c461881'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:25.293864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f3ed0d7cd849d1ba2647711c461881'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:25.313294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1052/2102] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:24 2022] DELETE /identity/v3/users/b2f3ed0d7cd849d1ba2647711c461881 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:25.318176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:25.318692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:25.318692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:25.337762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:25.341684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:25.365704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:25.406103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1051/2103] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:25.416193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:25.417674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:25.476419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b7c15-4da0-4d45-9c6e-395a39a74f5d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:25.480640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:25.481286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:25.481568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:25.481842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:25.490650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:25.492053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:25.501969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1053/2104] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:25.978999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:25.981571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:25.996121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af6c6b0-784c-478c-a552-1eea9c272ad2 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:26.005216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:26.005216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:26.005216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:26.005216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] PATH_INFO: `/v3/projects/6d5096b428034c649f5da60f0f182293` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:26.006642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5096b428034c649f5da60f0f182293)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:26.008986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:26.177978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5096b428034c649f5da60f0f182293', 'request_id': 'req-79189304-ac08-4118-89e1-d2cc695f9a2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:26.184834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5096b428034c649f5da60f0f182293', 'request_id': 'req-79189304-ac08-4118-89e1-d2cc695f9a2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:26.191246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5096b428034c649f5da60f0f182293', 'request_id': 'req-79189304-ac08-4118-89e1-d2cc695f9a2d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:26.285606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] The token cache is being invalidate because project 6d5096b428034c649f5da60f0f182293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:26.285894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:26.286511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:26.288069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1052/2105] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:25 2022] DELETE /identity/v3/projects/6d5096b428034c649f5da60f0f182293 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:29.546262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:29.547744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:29.609558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa451c2-b1fc-4620-91df-8ac6d90fa1be service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:29.614575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:29.657304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:29.657945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:29.658225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:29.658500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:29.660422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:29.741699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:29.743176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba536187-bc2e-4605-b34f-53f53e20d7a2 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:29.752962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1054/2106] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:35.676461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:35.677957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:35.744451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79189304-ac08-4118-89e1-d2cc695f9a2d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:35.749924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:35.750794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:35.751078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:35.751354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] PATH_INFO: `/v3/users/b3b514f5e7a845c498a42d108edebbdc` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:35.752544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b514f5e7a845c498a42d108edebbdc)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:35.754487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:35.945953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b514f5e7a845c498a42d108edebbdc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:35.950691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:35.958448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b514f5e7a845c498a42d108edebbdc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:35.959955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b514f5e7a845c498a42d108edebbdc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:35.965754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b514f5e7a845c498a42d108edebbdc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.017852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b514f5e7a845c498a42d108edebbdc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.024457 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1053/2107] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:35 2022] DELETE /identity/v3/users/b3b514f5e7a845c498a42d108edebbdc => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:36.028997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:36.029836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:36.030126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:36.051156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:36.051156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:36.118438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1055/2108] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:36.128705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:36.130279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:36.193825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d9431-2330-4f70-b1c6-7176537cfe09 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:36.198612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb387394-9062-4241-97ee-87dbfb759a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:36.205795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387394-9062-4241-97ee-87dbfb759a37 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:36.205795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387394-9062-4241-97ee-87dbfb759a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:36.205795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb387394-9062-4241-97ee-87dbfb759a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:36.209582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb387394-9062-4241-97ee-87dbfb759a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:36.211607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb387394-9062-4241-97ee-87dbfb759a37 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:36.230927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1054/2109] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:36.622321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:36.623915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:36.648532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0aac6c-a81c-47d5-bc8c-1364c7e99702 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:36.649286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:36.650255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:36.650661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:36.651036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] PATH_INFO: `/v3/projects/6385e7cf51d6408297156e7e7e4e8259` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:36.652892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6385e7cf51d6408297156e7e7e4e8259)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:36.654884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:36.816921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6385e7cf51d6408297156e7e7e4e8259', 'request_id': 'req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.823755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6385e7cf51d6408297156e7e7e4e8259', 'request_id': 'req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.825478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:36.944147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6385e7cf51d6408297156e7e7e4e8259', 'request_id': 'req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.956900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] The token cache is being invalidate because project 6385e7cf51d6408297156e7e7e4e8259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:36.957187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.957828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe7acee8-dd7d-4563-a26c-c0c7224fcd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:36.959811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1056/2110] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:36 2022] DELETE /identity/v3/projects/6385e7cf51d6408297156e7e7e4e8259 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:36.964978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:36.965459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:36.965645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:36.997232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:36.998591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:37.075013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1055/2111] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:37.082978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf447-92e7-4744-8afa-177618c941ff None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.083505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf447-92e7-4744-8afa-177618c941ff None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.083740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf447-92e7-4744-8afa-177618c941ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.101791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-754cf447-92e7-4744-8afa-177618c941ff None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:37.103073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-754cf447-92e7-4744-8afa-177618c941ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:37.112134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1057/2112] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:37.116540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.127725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3c34d-4937-4f2f-8e98-39999245e120 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:37.137573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:37.137573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.137573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.137573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.138580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:37.138580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:37.138580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:37.148853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1056/2113] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:37:37.154745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf447-92e7-4744-8afa-177618c941ff None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.167806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf447-92e7-4744-8afa-177618c941ff None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:37.172888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:37.173551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.173832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.174108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.174807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:37.176849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:37.269346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1058/2114] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:37 2022] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:37.273543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.283438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4661-7133-4136-a588-4d85f8ef4a69 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:37.347868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:37.348756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.349038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.349317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.350004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:37.351909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:37.360952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:37.472401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1057/2115] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:37 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:37.473712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.492520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c382a-70cb-4da1-a1d0-9524eba5363a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:37.498194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:37.498868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.499154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.499433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.500167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:37.502245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:37.514929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1059/2116] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:37.520270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.531468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f54da-5213-426a-abf1-375343035e61 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:37.536787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c9bf7-a611-4a1a-a687-dc56a215f72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:37.537446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c9bf7-a611-4a1a-a687-dc56a215f72e admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.537729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c9bf7-a611-4a1a-a687-dc56a215f72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.544481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c9bf7-a611-4a1a-a687-dc56a215f72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.544481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c9bf7-a611-4a1a-a687-dc56a215f72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:37.544481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c9bf7-a611-4a1a-a687-dc56a215f72e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:37.551452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1058/2117] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:37.555652 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.570389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187da5d-39d3-4be6-b154-95d29a517f41 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:37.576046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:37.576957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.577238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.577513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] PATH_INFO: `/v3/projects/7e775d4cbbd04f59af1111d58d4f95a6/users/5908f05bbe9a4976ad230265d92d120e/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.593244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e775d4cbbd04f59af1111d58d4f95a6, user_id=5908f05bbe9a4976ad230265d92d120e, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:37.595925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:37.841355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1060/2118] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:37 2022] PUT /identity/v3/projects/7e775d4cbbd04f59af1111d58d4f95a6/users/5908f05bbe9a4976ad230265d92d120e/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:37.852892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:37.853193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:37.853476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:37.898839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] MFA Rules not processed for user `5908f05bbe9a4976ad230265d92d120e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:37.900095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:37.985316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1059/2119] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:37.997577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:37.999427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:38.060648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3deb2cf-d7fc-4a2e-96f8-d6f3e92da14f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:38.065422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3974b6e-1cef-4d0f-8837-a91829c37a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:38.066534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3974b6e-1cef-4d0f-8837-a91829c37a39 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:38.066831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3974b6e-1cef-4d0f-8837-a91829c37a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:38.067537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3974b6e-1cef-4d0f-8837-a91829c37a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:38.078531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3974b6e-1cef-4d0f-8837-a91829c37a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:38.080056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3974b6e-1cef-4d0f-8837-a91829c37a39 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:38.090307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1061/2120] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:37 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:38.197785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:38.199309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:38.367949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c1595-c419-4dbc-a881-dc2bd8a3556d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:38.375041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:38.379377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:38.379377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:38.379377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] PATH_INFO: `/v3/users/f5b10a41133c45ee8868d2fae9d382ec` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:38.379377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b10a41133c45ee8868d2fae9d382ec)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:38.380286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:38.387864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:38.573109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b10a41133c45ee8868d2fae9d382ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:38.585681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b10a41133c45ee8868d2fae9d382ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:38.586409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b10a41133c45ee8868d2fae9d382ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:38.593519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b10a41133c45ee8868d2fae9d382ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:38.653036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b10a41133c45ee8868d2fae9d382ec'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:38.662607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1060/2121] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:38 2022] DELETE /identity/v3/users/f5b10a41133c45ee8868d2fae9d382ec => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:38.665318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:38.671707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:38.672094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:38.701473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:38.702690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:38.765778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1062/2122] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:38.777041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:38.778465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:38.877813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8630b4aa-3fdf-45ce-b9e8-1afebb04bf6c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:38.881504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd52ec-fac7-4d42-b0de-7471599ffdbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:38.882148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd52ec-fac7-4d42-b0de-7471599ffdbe service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:38.882430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd52ec-fac7-4d42-b0de-7471599ffdbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:38.882704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd52ec-fac7-4d42-b0de-7471599ffdbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:38.892876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd52ec-fac7-4d42-b0de-7471599ffdbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:38.894451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd52ec-fac7-4d42-b0de-7471599ffdbe service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:38.906123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1061/2123] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:39.374859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:39.374859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:39.390097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f41ab6-aaf4-4de5-821c-f18af07fe14f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:39.410072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:39.410072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:39.410496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:39.410496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] PATH_INFO: `/v3/projects/28b71cc5bc7c46a49d6413d16b32e836` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:39.413220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b71cc5bc7c46a49d6413d16b32e836)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:39.417118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:39.430196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:39.560951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b71cc5bc7c46a49d6413d16b32e836', 'request_id': 'req-32635721-0ab3-4731-98f8-39b08893656f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:39.572861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b71cc5bc7c46a49d6413d16b32e836', 'request_id': 'req-32635721-0ab3-4731-98f8-39b08893656f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:39.756817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b71cc5bc7c46a49d6413d16b32e836', 'request_id': 'req-32635721-0ab3-4731-98f8-39b08893656f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:39.771142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] The token cache is being invalidate because project 28b71cc5bc7c46a49d6413d16b32e836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:39.771489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:39.772533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-32635721-0ab3-4731-98f8-39b08893656f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:39.774320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1063/2124] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:39 2022] DELETE /identity/v3/projects/28b71cc5bc7c46a49d6413d16b32e836 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:39.779142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:39.779593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:39.779765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:39.822667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:39.829638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:39.858397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:39.884247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1062/2125] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:39.892135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:39.892433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:39.892904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:39.916283 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:39.918314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:39.930293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1064/2126] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:39.934581 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:39.944438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4c36-e29e-4e10-a1ad-eb7bde8fd8b7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:39.949498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:39.950147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:39.950432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:39.950707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:39.951438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:39.951748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:39.953378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:39.966260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1063/2127] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:37:39.971047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:39.980853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c31c2c-1462-4700-962d-ffe42b04efa2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:39.988762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:39.989410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:39.989691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:39.994237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:39.994237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:39.994237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.082230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1065/2128] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:39 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:40.086951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.097513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318299-c41e-42a4-b873-4cb630af0473 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.165197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.166066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.166450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.166932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.168285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:40.170381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.257482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1064/2129] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:40 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:40.262629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.273991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167f993d-b52f-42a5-ba83-decb335775e2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.279413 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.280069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.280350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.280633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.281396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:40.282976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.297327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1066/2130] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:40.298331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.308354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718477f8-d4b0-4bbb-9196-fb59c908483d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.314335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f204-5d5d-4f7b-b3a7-ca72864d6b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.314335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f204-5d5d-4f7b-b3a7-ca72864d6b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.314335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f204-5d5d-4f7b-b3a7-ca72864d6b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.314335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f204-5d5d-4f7b-b3a7-ca72864d6b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.314922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130f204-5d5d-4f7b-b3a7-ca72864d6b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:40.316507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130f204-5d5d-4f7b-b3a7-ca72864d6b6a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.327385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1065/2131] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:40.331750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.343765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00239b84-24a7-4981-be34-8f3ede9ac020 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.349212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.350091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.350373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.351155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] PATH_INFO: `/v3/projects/4d82a32eeae24d9d967008c89ab5934d/users/0b472eb23c1a4f2ca0c24061862d7178/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.365902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d82a32eeae24d9d967008c89ab5934d, user_id=0b472eb23c1a4f2ca0c24061862d7178, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:40.368586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.449133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1067/2132] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:40 2022] PUT /identity/v3/projects/4d82a32eeae24d9d967008c89ab5934d/users/0b472eb23c1a4f2ca0c24061862d7178/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:40.461009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.461296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.461570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.489609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] MFA Rules not processed for user `0b472eb23c1a4f2ca0c24061862d7178`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:40.490890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:40.568729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1066/2133] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:40.572204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.656914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c7354-1b01-42c3-a9b4-b83b98303d03 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.662157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.662891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.663253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.663658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.664365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:40.668650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.772360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1068/2134] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:40 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:40.776708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.789809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ca2b-4f46-4824-9172-ac30606c50c6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.826990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:40.855492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.856161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.856437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.856741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.859537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:40.859537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:40.977056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1067/2135] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:40 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:40.981870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:40.991658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c2fc6-0084-4359-9387-73a9037264e9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:40.996974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:40.997619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:40.997904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:40.998219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:40.998926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:41.000646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:41.012364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1069/2136] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:41.016998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:41.026847 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cc8b4-14e5-491f-87bd-6f676a511407 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:41.031388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:41.032254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:41.032537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:41.032844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] PATH_INFO: `/v3/projects/4193735d4a3046bd9669ba890ab1c9e0/users/bc7e9247f41c4909bbb33b94e93dc016/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:41.047751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4193735d4a3046bd9669ba890ab1c9e0, user_id=bc7e9247f41c4909bbb33b94e93dc016, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:41.050352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:41.112820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1068/2137] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:41 2022] PUT /identity/v3/projects/4193735d4a3046bd9669ba890ab1c9e0/users/bc7e9247f41c4909bbb33b94e93dc016/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:41.117010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:41.127630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3851543-088f-4501-8525-2feb12f37df1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:41.132408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:41.205385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2027438f-ee26-4a7c-9b97-3d346558e343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:41.206122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027438f-ee26-4a7c-9b97-3d346558e343 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:41.206761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027438f-ee26-4a7c-9b97-3d346558e343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:41.206861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2027438f-ee26-4a7c-9b97-3d346558e343 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:41.208214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027438f-ee26-4a7c-9b97-3d346558e343 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:41.209830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2027438f-ee26-4a7c-9b97-3d346558e343 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:41.223926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1070/2138] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:41.225593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:41.237240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b524515-33cf-495b-bf6a-732b5a700063 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:41.242447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:41.243344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:41.243629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:41.243905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] PATH_INFO: `/v3/projects/4193735d4a3046bd9669ba890ab1c9e0/users/bc7e9247f41c4909bbb33b94e93dc016/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:41.246719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4193735d4a3046bd9669ba890ab1c9e0, user_id=bc7e9247f41c4909bbb33b94e93dc016, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:41.256251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:41.278188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1069/2139] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:41 2022] PUT /identity/v3/projects/4193735d4a3046bd9669ba890ab1c9e0/users/bc7e9247f41c4909bbb33b94e93dc016/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:41.289393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:41.289669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:41.289961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:41.321808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] MFA Rules not processed for user `bc7e9247f41c4909bbb33b94e93dc016`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:41.323411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:41.397047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1071/2140] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:41.409007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:41.410974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:41.471820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe1c04-5aa6-46a8-9a40-a41dea4c8b92 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:41.475540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:41.476192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:41.476471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:41.476785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:41.538063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:41.539569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:41.549948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1070/2141] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:44.862914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:44.864437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:44.880254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:44.943077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:44.979151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2125368-43f1-4122-9e0d-8999a67186df None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:44.985093 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:44.985976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:44.986254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:44.986532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] PATH_INFO: `/v3/users/5908f05bbe9a4976ad230265d92d120e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:44.987756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5908f05bbe9a4976ad230265d92d120e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:44.988274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e5601-e0d3-47f2-bd1b-d4cc73c0509f service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:44.989776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:44.994523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:44.996529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:44.996771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:44.997048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] PATH_INFO: `/v3/users/0b472eb23c1a4f2ca0c24061862d7178` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:44.998592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b472eb23c1a4f2ca0c24061862d7178)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:45.001586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:45.157299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:45.169673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5908f05bbe9a4976ad230265d92d120e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.170240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5908f05bbe9a4976ad230265d92d120e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.200564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b472eb23c1a4f2ca0c24061862d7178'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.213339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b472eb23c1a4f2ca0c24061862d7178'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.214661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b472eb23c1a4f2ca0c24061862d7178'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.221408 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b472eb23c1a4f2ca0c24061862d7178'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.279856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5908f05bbe9a4976ad230265d92d120e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.289033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5908f05bbe9a4976ad230265d92d120e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.290021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-b03c25be-025f-4f41-a574-2edeb048b513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5908f05bbe9a4976ad230265d92d120e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.311089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1072/2142] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:44 2022] DELETE /identity/v3/users/5908f05bbe9a4976ad230265d92d120e => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:45.315790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:45.316259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:45.316582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:45.333859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:45.335061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:45.361409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-64d993d5-f689-419d-8e13-e20556a5d99c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b472eb23c1a4f2ca0c24061862d7178'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:45.368513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1071/2143] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:44 2022] DELETE /identity/v3/users/0b472eb23c1a4f2ca0c24061862d7178 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:45.372801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:45.373091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:45.373390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:45.391631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:45.392870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:45.398474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1073/2144] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:45.409276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:45.410616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:45.469315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1072/2145] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:45.479342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:45.480786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:45.493819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed891c0a-a26f-4ae6-9e34-0e352ef2f121 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:45.569530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:45.570353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:45.570792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:45.571223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:45.571507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d16a1-6d11-47a6-8fff-cb7cdf481d2c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:45.576554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:45.577146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:45.577438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:45.577703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:45.594390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:45.597787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:45.598152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:45.600653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:45.612402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1073/2146] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:45.613104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1074/2147] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:37:46.139189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:46.139767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:46.141347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:46.142777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:46.157620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43919-86fd-4c1a-ada7-2d4d9230c7ba service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:46.158307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:46.167810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abedd728-8ba8-4da8-938d-a51ae93d3d3b service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:46.173885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:46.173885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:46.174096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:46.174192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] PATH_INFO: `/v3/projects/7e775d4cbbd04f59af1111d58d4f95a6` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:46.175389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e775d4cbbd04f59af1111d58d4f95a6)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:46.177549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:46.177674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:46.179146 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:46.179459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:46.179735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] PATH_INFO: `/v3/projects/4d82a32eeae24d9d967008c89ab5934d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:46.181354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d82a32eeae24d9d967008c89ab5934d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:46.184137 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:46.186906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:46.283808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e775d4cbbd04f59af1111d58d4f95a6', 'request_id': 'req-6264c446-b1cc-46aa-9d9c-705e4963cab2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.290215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e775d4cbbd04f59af1111d58d4f95a6', 'request_id': 'req-6264c446-b1cc-46aa-9d9c-705e4963cab2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.297106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e775d4cbbd04f59af1111d58d4f95a6', 'request_id': 'req-6264c446-b1cc-46aa-9d9c-705e4963cab2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.299211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d82a32eeae24d9d967008c89ab5934d', 'request_id': 'req-df288c75-9824-4069-a00a-a59d52d03d32'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.306273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d82a32eeae24d9d967008c89ab5934d', 'request_id': 'req-df288c75-9824-4069-a00a-a59d52d03d32'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.395668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] The token cache is being invalidate because project 7e775d4cbbd04f59af1111d58d4f95a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:46.395999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.396744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.398343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1074/2148] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:46 2022] DELETE /identity/v3/projects/7e775d4cbbd04f59af1111d58d4f95a6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:46.441498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d82a32eeae24d9d967008c89ab5934d', 'request_id': 'req-df288c75-9824-4069-a00a-a59d52d03d32'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.454326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] The token cache is being invalidate because project 4d82a32eeae24d9d967008c89ab5934d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:46.454525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.455181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.457171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1075/2149] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:46 2022] DELETE /identity/v3/projects/4d82a32eeae24d9d967008c89ab5934d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:46.461294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:46.462835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:46.552829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264c446-b1cc-46aa-9d9c-705e4963cab2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:46.622216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:46.623244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:46.623524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:46.623793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] PATH_INFO: `/v3/users/bc7e9247f41c4909bbb33b94e93dc016` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:46.625130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7e9247f41c4909bbb33b94e93dc016)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:46.627088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:46.909708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:46.921663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7e9247f41c4909bbb33b94e93dc016'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.946554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7e9247f41c4909bbb33b94e93dc016'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.947563 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7e9247f41c4909bbb33b94e93dc016'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:46.955615 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7e9247f41c4909bbb33b94e93dc016'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.024738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-99ca6351-540a-4312-ac58-2945f2357a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7e9247f41c4909bbb33b94e93dc016'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.035072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1075/2150] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:46 2022] DELETE /identity/v3/users/bc7e9247f41c4909bbb33b94e93dc016 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:47.477142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:47.478634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:47.504943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df288c75-9824-4069-a00a-a59d52d03d32 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:47.571395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:47.572576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:47.572890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:47.573164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] PATH_INFO: `/v3/projects/4193735d4a3046bd9669ba890ab1c9e0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:47.574563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4193735d4a3046bd9669ba890ab1c9e0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:47.576602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:47.679070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4193735d4a3046bd9669ba890ab1c9e0', 'request_id': 'req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.686643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4193735d4a3046bd9669ba890ab1c9e0', 'request_id': 'req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.806977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4193735d4a3046bd9669ba890ab1c9e0', 'request_id': 'req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.838894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] The token cache is being invalidate because project 4193735d4a3046bd9669ba890ab1c9e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:47.840154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.840154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e5aa7b28-41bc-4015-8b9d-8a347ddbf24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:47.841881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1076/2151] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:47 2022] DELETE /identity/v3/projects/4193735d4a3046bd9669ba890ab1c9e0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:47.846658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:47.847129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:47.847209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:47.865369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:47.866573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:47.945017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1076/2152] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:47.953378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:47.953669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:47.953970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:47.974037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:47.975248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:47.984669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1077/2153] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:47.989481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.004299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783fc870-1f4b-47aa-b9a3-fd5f237585ed None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.014390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.015095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.015574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.015983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.016872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:48.017183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.020038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.039439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1077/2154] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:37:48.044729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.054511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd5a75-50aa-45b0-bfa6-b402ecc1f5f1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.064172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.065423 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.066022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.066454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.067555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.069566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.097595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:48.164434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1078/2155] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:48 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:48.165243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.185358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d41f3-199a-4779-9447-82d0ae2ee0a8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.254261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.254925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.255203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.255479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.256169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.258097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.378094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1078/2156] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:48 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:37:48.382445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.393504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250b2402-799a-485a-8fea-9dd314c1b040 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.398109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.398910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.399171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.399677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.402669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.402669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.413294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1079/2157] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:48.417473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.427791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280590b4-3d95-4dbd-956c-c48694c9379a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.433549 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc1330-726e-43ca-9a81-3a49144d84bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.434366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1330-726e-43ca-9a81-3a49144d84bc admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.434647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1330-726e-43ca-9a81-3a49144d84bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.435047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc1330-726e-43ca-9a81-3a49144d84bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.435782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1330-726e-43ca-9a81-3a49144d84bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.437556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc1330-726e-43ca-9a81-3a49144d84bc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.449401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1079/2158] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:48.453676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.464089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd35d5c-90f7-4f22-9fd3-0e43e18b58ae admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.469794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.469794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.470017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.470241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] PATH_INFO: `/v3/projects/56c1678cb109439693d329a3cdb0b98c/users/901612dfe11543868062a69620aaf4f2/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.487408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c1678cb109439693d329a3cdb0b98c, user_id=901612dfe11543868062a69620aaf4f2, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.490503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.571581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1080/2159] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:48 2022] PUT /identity/v3/projects/56c1678cb109439693d329a3cdb0b98c/users/901612dfe11543868062a69620aaf4f2/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:48.582371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.582767 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.583195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.611498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] MFA Rules not processed for user `901612dfe11543868062a69620aaf4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:48.612760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:48.618455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:48.682488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1080/2160] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:48.685724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.750186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d95926-6d4a-43e6-b5fe-b1369f69f32d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.755010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.755664 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.755943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.759016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.759016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.760713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:48.850718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1081/2161] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:48 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:48.851697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:48.863087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ca9b-8929-48e6-9926-fb551cc5e293 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:48.932146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:48.933412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:48.933692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:48.933962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:48.934688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:48.936737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.028148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1081/2162] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:48 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:49.032290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.044408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960de5dd-458f-4a09-8df7-4acfec69406e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.050616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.050616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.050828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.050974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.051701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.053340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.065374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1082/2163] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:49.069445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.080492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c5be-ef04-486b-bcf5-b8d791c3327d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.085218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473f482-722c-471d-8be2-6b076fc49417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.085997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f482-722c-471d-8be2-6b076fc49417 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.086283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f482-722c-471d-8be2-6b076fc49417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.086558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473f482-722c-471d-8be2-6b076fc49417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.087292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473f482-722c-471d-8be2-6b076fc49417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.089225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473f482-722c-471d-8be2-6b076fc49417 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.102385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1082/2164] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:49.106698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.117628 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2818-0e95-4afc-a1a3-366d967aec15 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.124933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.125894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.126276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.126758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] PATH_INFO: `/v3/projects/20956e08075c4c00afb93afd91cf6860/users/5f319cc3a056430cb647947da8639280/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.143655 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=20956e08075c4c00afb93afd91cf6860, user_id=5f319cc3a056430cb647947da8639280, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.147073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.230659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1083/2165] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:49 2022] PUT /identity/v3/projects/20956e08075c4c00afb93afd91cf6860/users/5f319cc3a056430cb647947da8639280/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:49.242004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddc85f-4a38-4927-84a6-a0de0ebbef0d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.242485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddc85f-4a38-4927-84a6-a0de0ebbef0d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.242843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddc85f-4a38-4927-84a6-a0de0ebbef0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.284571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-43ddc85f-4a38-4927-84a6-a0de0ebbef0d None None] MFA Rules not processed for user `5f319cc3a056430cb647947da8639280`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:49.288871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-43ddc85f-4a38-4927-84a6-a0de0ebbef0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:49.386660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1083/2166] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:37:49.387904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.513187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab328f1-e5b1-4d5d-b6ee-568fed5eb4ee admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.519442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.520270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.520634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.520973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.521739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.524016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.539881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:49.579271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.579565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.579848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.597869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] MFA Rules not processed for user `e1b1a5aa634d40709b14bd2f7355a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:49.599074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:49.609037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:49.655791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1084/2167] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:49.671552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1084/2168] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:49.675680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.692051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0088cc-f428-4464-91b0-3bb31bfe47d3 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.783489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.783489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.783489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.783489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.783836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.783836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.868904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1085/2169] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:49 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:49.872886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.883158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6036e-8705-4f6a-9bec-4242108c34cf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.887921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.888670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.889156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.889437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.890169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.893268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:49.903012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1085/2170] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:49.907562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:49.919055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cbf86-d7f8-44be-90e0-3b4cd78d4737 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:49.923928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:49.924950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:49.925235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:49.925507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] PATH_INFO: `/v3/projects/054995b56b15462f838c54981c12bed1/users/17312af0626845eeadfcc9057147c928/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:49.955215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054995b56b15462f838c54981c12bed1, user_id=17312af0626845eeadfcc9057147c928, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:49.959376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:50.027175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1086/2171] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:49 2022] PUT /identity/v3/projects/054995b56b15462f838c54981c12bed1/users/17312af0626845eeadfcc9057147c928/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:50.031107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:50.041771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac7941-631a-486c-aa35-0f67976c50a1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:50.104951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16db45-3043-4368-8c27-9ffedcd14921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:50.105544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16db45-3043-4368-8c27-9ffedcd14921 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:50.105825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16db45-3043-4368-8c27-9ffedcd14921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:50.106107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16db45-3043-4368-8c27-9ffedcd14921 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:50.106825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16db45-3043-4368-8c27-9ffedcd14921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:50.108460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16db45-3043-4368-8c27-9ffedcd14921 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:50.122010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1086/2172] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:50.123223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:50.135285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807c0d1-f3ac-4a3b-8b58-83a5c8ed2e25 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:50.146131 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:50.147082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:50.147372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:50.147656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] PATH_INFO: `/v3/projects/054995b56b15462f838c54981c12bed1/users/17312af0626845eeadfcc9057147c928/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:50.149797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=054995b56b15462f838c54981c12bed1, user_id=17312af0626845eeadfcc9057147c928, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:50.153400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:50.169522 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1087/2173] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:50 2022] PUT /identity/v3/projects/054995b56b15462f838c54981c12bed1/users/17312af0626845eeadfcc9057147c928/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:50.179712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96246f-3da4-4fd2-8796-151e52316628 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:50.180003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96246f-3da4-4fd2-8796-151e52316628 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:50.180278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96246f-3da4-4fd2-8796-151e52316628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:50.208129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-6e96246f-3da4-4fd2-8796-151e52316628 None None] MFA Rules not processed for user `17312af0626845eeadfcc9057147c928`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:50.209350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6e96246f-3da4-4fd2-8796-151e52316628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:50.286686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1087/2174] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:50.298925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:50.300271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:50.365238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0210464-3691-4c8f-9171-6c6d48d5a5b8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:50.368964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:50.369612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:50.369894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:50.373513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:50.431278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:50.433813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:50.441223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:50.451199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:50.451715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:50.452116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:50.455965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1088/2175] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:50.506964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] MFA Rules not processed for user `58be610f6adc46269a46db36f41d6b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:50.508194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:50.600483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1088/2176] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:52.489030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:52.506047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e55bd-24e4-49b0-b6f3-1f1a1566cb36 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:52.510876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:52.511878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:52.512497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:52.513103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:52.584068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:52.585545 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:52.598585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1089/2177] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:54.256639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:54.266356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9f4ae-8fbf-4235-a006-a84b3b80fa1e None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:54.269852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:54.270487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:54.270768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:54.271042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:54.278909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:54.280998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:54.282414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:54.292755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1089/2178] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:55.201121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:55.202811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:55.295300 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104549e7-5059-4e9e-b34d-45705476f0d5 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:55.302620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:55.305555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:55.305555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:55.305555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] PATH_INFO: `/v3/users/0aa741cb2cb7429db7d4042b7b37cfff` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:55.306771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa741cb2cb7429db7d4042b7b37cfff)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:55.308953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:55.788225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa741cb2cb7429db7d4042b7b37cfff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:55.819482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa741cb2cb7429db7d4042b7b37cfff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:55.820580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa741cb2cb7429db7d4042b7b37cfff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:55.825406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:55.830873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa741cb2cb7429db7d4042b7b37cfff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:55.911141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa741cb2cb7429db7d4042b7b37cfff'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:55.919590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1090/2179] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:55 2022] DELETE /identity/v3/users/0aa741cb2cb7429db7d4042b7b37cfff => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:37:56.190613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:56.206974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5a708-3074-4a30-8686-9f722ccbc252 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:56.280162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:56.281089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:56.281548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:56.281968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] PATH_INFO: `/v3/projects/6444ab116766476ebe2be37ae0b95c1c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:56.283335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6444ab116766476ebe2be37ae0b95c1c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:56.285351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:56.407155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6444ab116766476ebe2be37ae0b95c1c', 'request_id': 'req-3e8bb64e-981c-490f-a406-e6f14ee090c8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.418925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6444ab116766476ebe2be37ae0b95c1c', 'request_id': 'req-3e8bb64e-981c-490f-a406-e6f14ee090c8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.493355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6444ab116766476ebe2be37ae0b95c1c', 'request_id': 'req-3e8bb64e-981c-490f-a406-e6f14ee090c8'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.508109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] The token cache is being invalidate because project 6444ab116766476ebe2be37ae0b95c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:56.508399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.509079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.513542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1090/2180] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:56 2022] DELETE /identity/v3/projects/6444ab116766476ebe2be37ae0b95c1c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:56.514872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:56.516592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:56.530556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0b272-ff2c-46f4-bd78-28743cd62298 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:56.612165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:56.613007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:56.613293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:56.613567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] PATH_INFO: `/v3/users/b6ce288a0e29404384882089e4eae16e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:56.614835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ce288a0e29404384882089e4eae16e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:56.616865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:56.820073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ce288a0e29404384882089e4eae16e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.833535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ce288a0e29404384882089e4eae16e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.834271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ce288a0e29404384882089e4eae16e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.842303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ce288a0e29404384882089e4eae16e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.921864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-35db87f7-4a62-4009-b262-16df77d7e995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ce288a0e29404384882089e4eae16e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:56.929543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1091/2181] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:56 2022] DELETE /identity/v3/users/b6ce288a0e29404384882089e4eae16e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:57.244032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:57.247087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:57.267399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bb64e-981c-490f-a406-e6f14ee090c8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:57.368678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:57.369969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:57.371022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:57.371507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] PATH_INFO: `/v3/projects/4b1e6f0eab7c4fdaa5b4f8362ce7ba48` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:57.373828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1e6f0eab7c4fdaa5b4f8362ce7ba48)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:57.376261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:57.485944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:57.503260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1e6f0eab7c4fdaa5b4f8362ce7ba48', 'request_id': 'req-285a1014-a81c-4772-ac44-243562f05189'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:57.514565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1e6f0eab7c4fdaa5b4f8362ce7ba48', 'request_id': 'req-285a1014-a81c-4772-ac44-243562f05189'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:57.589564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1e6f0eab7c4fdaa5b4f8362ce7ba48', 'request_id': 'req-285a1014-a81c-4772-ac44-243562f05189'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:57.614531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] The token cache is being invalidate because project 4b1e6f0eab7c4fdaa5b4f8362ce7ba48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:37:57.615062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:57.615764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-285a1014-a81c-4772-ac44-243562f05189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:57.623852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:57.624735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1091/2182] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:37:57 2022] DELETE /identity/v3/projects/4b1e6f0eab7c4fdaa5b4f8362ce7ba48 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:57.624958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:57.625249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:57.655855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:57.657108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:57.723057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:57.736764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1092/2183] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:57.745249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:57.746073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:57.746533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:57.768360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:57.769656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:57.780602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1092/2184] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:57.785251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:57.798311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ba16f-b89c-4f80-8677-bb061cac1310 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:57.805061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:57.805061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:57.805061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:57.805061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:57.805358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:37:57.805602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:57.807094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:57.820040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1093/2185] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:37:57.824820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:57.835590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7854783-f82c-474d-b0c2-49c38738abe9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:57.841547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:57.842289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:57.842638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:57.843130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:57.844647 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:57.845769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:57.941550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1093/2186] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:37:57 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:57.945761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:57.956489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43b6ce-2f1d-4a71-a777-7a1cc2f10081 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:58.014573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:58.015168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:58.015448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:58.015756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:58.016403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:58.018498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:58.167922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1094/2187] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:37:57 2022] POST /identity/v3/users => generated 288 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:37:58.172694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:58.183259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d6af3-e972-4164-b9e3-efe468763881 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:58.187898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:58.188559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:58.188873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:58.189148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:58.189870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:58.191452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:58.204998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1094/2188] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:37:58.213399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:58.226001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81d6f0-5846-4ea4-a190-17d4e27c76b8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:58.231716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ac6c3-fc38-428e-b0e3-b4bba493915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:58.232401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac6c3-fc38-428e-b0e3-b4bba493915f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:58.232859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac6c3-fc38-428e-b0e3-b4bba493915f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:58.233222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ac6c3-fc38-428e-b0e3-b4bba493915f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:58.234002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ac6c3-fc38-428e-b0e3-b4bba493915f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:58.235754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ac6c3-fc38-428e-b0e3-b4bba493915f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:58.251204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1095/2189] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:37:58.253730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:58.264674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7461bc7c-2675-47c0-b02b-b38bd95168d2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:58.269409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:58.270320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:58.270602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:58.270875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] PATH_INFO: `/v3/projects/b04e4151d8864eeb92e4c7725290ca8d/users/cc21914218b347898f0c94642c8ea984/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:58.285846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04e4151d8864eeb92e4c7725290ca8d, user_id=cc21914218b347898f0c94642c8ea984, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:58.288507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:58.371108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1095/2190] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:37:58 2022] PUT /identity/v3/projects/b04e4151d8864eeb92e4c7725290ca8d/users/cc21914218b347898f0c94642c8ea984/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:58.381598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7c95-5408-4919-ab0b-c14602a06ea1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:58.381943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7c95-5408-4919-ab0b-c14602a06ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:58.382273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7c95-5408-4919-ab0b-c14602a06ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:58.410015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-94ee7c95-5408-4919-ab0b-c14602a06ea1 None None] MFA Rules not processed for user `cc21914218b347898f0c94642c8ea984`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:58.411220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-94ee7c95-5408-4919-ab0b-c14602a06ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:58.475137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1096/2191] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:58.486100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:58.487823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:58.544933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed0092-7df2-49b7-8112-25da3464dc74 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:58.557657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:58.558825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:58.559267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:58.559395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:58.568367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:58.570300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:58.580105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1096/2192] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:37:59.051592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:59.052066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:59.052066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:59.100542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:59.100542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:59.144776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:59.187869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1097/2193] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:59.225731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:59.227243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:59.276853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:59.278606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:59.366954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:37:59.394736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2102eb-a295-411f-ba19-c245201ed7ab service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:59.395107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5a978-30af-4023-b1f1-990ea698acf4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:59.400201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:59.400377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aead9b-a4e1-4306-92cb-dc6cc63270e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:59.401061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aead9b-a4e1-4306-92cb-dc6cc63270e4 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:59.401335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:59.401450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aead9b-a4e1-4306-92cb-dc6cc63270e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:59.402353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aead9b-a4e1-4306-92cb-dc6cc63270e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:59.402955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:59.403510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] PATH_INFO: `/v3/users/901612dfe11543868062a69620aaf4f2` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:59.404965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901612dfe11543868062a69620aaf4f2)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:59.407568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:59.425988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aead9b-a4e1-4306-92cb-dc6cc63270e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:59.428471 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aead9b-a4e1-4306-92cb-dc6cc63270e4 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:59.484528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1097/2194] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:37:59.650432 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901612dfe11543868062a69620aaf4f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:59.665001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901612dfe11543868062a69620aaf4f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:59.665197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901612dfe11543868062a69620aaf4f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:59.674289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901612dfe11543868062a69620aaf4f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:59.739691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901612dfe11543868062a69620aaf4f2'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:37:59.746781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1098/2195] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:37:59 2022] DELETE /identity/v3/users/901612dfe11543868062a69620aaf4f2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:37:59.751336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed88f21-7fd0-413f-b89c-a1cf1fed87d8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:59.751646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed88f21-7fd0-413f-b89c-a1cf1fed87d8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:59.751898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed88f21-7fd0-413f-b89c-a1cf1fed87d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:59.770342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-aed88f21-7fd0-413f-b89c-a1cf1fed87d8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:37:59.771571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-aed88f21-7fd0-413f-b89c-a1cf1fed87d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:59.858424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1098/2196] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:37:59.870535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:37:59.872048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:37:59.938203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2925f-6875-4d77-9a45-d0b433859071 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:37:59.942128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:37:59.942901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:37:59.943250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:37:59.943592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:37:59.955454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:37:59.957105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:37:59.969932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1099/2197] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:00.489646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:00.490560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:00.490905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:00.510744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] MFA Rules not processed for user `cc21914218b347898f0c94642c8ea984`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:00.512098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:00.547930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:00.549863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:00.575683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cd5ea-4514-46d2-84e1-0fc0ad12cc44 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:00.590311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:00.591190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:00.591459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:00.591732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] PATH_INFO: `/v3/projects/56c1678cb109439693d329a3cdb0b98c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:00.597392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c1678cb109439693d329a3cdb0b98c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:00.607807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:00.613428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1099/2198] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:38:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:38:00.618541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:00.758704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c1678cb109439693d329a3cdb0b98c', 'request_id': 'req-391471c9-5bd7-4e49-a286-6bc3780fcf29'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:00.779234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c1678cb109439693d329a3cdb0b98c', 'request_id': 'req-391471c9-5bd7-4e49-a286-6bc3780fcf29'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:00.794531 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c1678cb109439693d329a3cdb0b98c', 'request_id': 'req-391471c9-5bd7-4e49-a286-6bc3780fcf29'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:00.872662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] The token cache is being invalidate because project 56c1678cb109439693d329a3cdb0b98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:38:00.877119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:00.877119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:00.881124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1100/2199] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:38:00 2022] DELETE /identity/v3/projects/56c1678cb109439693d329a3cdb0b98c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:00.882429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:00.896354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac99e8-6db4-4c51-b98c-50d612e489e7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:01.035100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:01.036212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:01.042045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:01.042045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] PATH_INFO: `/v3/users/5f319cc3a056430cb647947da8639280` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:01.042045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f319cc3a056430cb647947da8639280)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:01.042045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:01.467320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:01.501245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f319cc3a056430cb647947da8639280'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:01.505073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f319cc3a056430cb647947da8639280'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:01.603084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f319cc3a056430cb647947da8639280'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:01.615056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f319cc3a056430cb647947da8639280'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:01.615822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f319cc3a056430cb647947da8639280'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:01.681170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1100/2200] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:38:00 2022] DELETE /identity/v3/users/5f319cc3a056430cb647947da8639280 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:02.257624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:02.257624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:02.295624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391471c9-5bd7-4e49-a286-6bc3780fcf29 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:02.401028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:02.402995 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:02.403399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:02.403689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] PATH_INFO: `/v3/projects/20956e08075c4c00afb93afd91cf6860` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:02.405062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20956e08075c4c00afb93afd91cf6860)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:02.407729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:02.594297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20956e08075c4c00afb93afd91cf6860', 'request_id': 'req-198b09fc-f608-430a-a179-ce62cf4efe41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:02.605816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20956e08075c4c00afb93afd91cf6860', 'request_id': 'req-198b09fc-f608-430a-a179-ce62cf4efe41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:02.614765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20956e08075c4c00afb93afd91cf6860', 'request_id': 'req-198b09fc-f608-430a-a179-ce62cf4efe41'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:02.702296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] The token cache is being invalidate because project 20956e08075c4c00afb93afd91cf6860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:38:02.702740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:02.703616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:02.705579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1101/2201] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:38:02 2022] DELETE /identity/v3/projects/20956e08075c4c00afb93afd91cf6860 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:02.709337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:02.716021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:02.733387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e95cf-7b74-41a3-ba3e-fc7d35c6eeed admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:02.800934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:02.802383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:02.802907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:02.803402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] PATH_INFO: `/v3/users/17312af0626845eeadfcc9057147c928` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:02.805292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17312af0626845eeadfcc9057147c928)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:02.807602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:03.048776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17312af0626845eeadfcc9057147c928'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:03.053102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17312af0626845eeadfcc9057147c928'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:03.140037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17312af0626845eeadfcc9057147c928'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:03.153425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17312af0626845eeadfcc9057147c928'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:03.154577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-98b2439c-abaf-4bd5-8866-5d4277fd6ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17312af0626845eeadfcc9057147c928'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:03.231375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1101/2202] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:38:02 2022] DELETE /identity/v3/users/17312af0626845eeadfcc9057147c928 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:04.113677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:04.115184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:04.137370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b09fc-f608-430a-a179-ce62cf4efe41 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:04.174677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:04.238917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:04.240063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:04.240633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:04.241091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] PATH_INFO: `/v3/projects/054995b56b15462f838c54981c12bed1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:04.242679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=054995b56b15462f838c54981c12bed1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:04.244857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:04.421685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '054995b56b15462f838c54981c12bed1', 'request_id': 'req-56f87729-e27e-4920-9bd2-58e00ca6d197'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:04.429075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '054995b56b15462f838c54981c12bed1', 'request_id': 'req-56f87729-e27e-4920-9bd2-58e00ca6d197'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:04.436630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '054995b56b15462f838c54981c12bed1', 'request_id': 'req-56f87729-e27e-4920-9bd2-58e00ca6d197'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:04.533157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] The token cache is being invalidate because project 054995b56b15462f838c54981c12bed1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:38:04.533768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:04.534605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-56f87729-e27e-4920-9bd2-58e00ca6d197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:04.536466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1102/2203] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:38:04 2022] DELETE /identity/v3/projects/054995b56b15462f838c54981c12bed1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:04.544136 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:04.544708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:04.544937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:04.584760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:04.586311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:04.655944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:04.711083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1102/2204] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:04.713319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:04.713617 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:04.714006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:04.741375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:04.742901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:04.775227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1103/2205] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:04.779224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:04.791414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda05e2-ecfd-4984-ae62-19339381e96a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:04.797444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:04.798331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:04.798768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:04.799219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:04.800118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:38:04.800598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:04.802438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:04.820122 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1103/2206] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:38:04.825175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:04.844124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04918329-ec24-4080-a9a4-8f241192e36f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:04.854373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:04.855785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:04.864809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:04.864809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:04.864809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:04.864809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:04.990452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1104/2207] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:38:04 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:38:04.991550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:05.013307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84136497-530f-4edd-92fb-3f6948a5eb5d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:05.119736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:05.121190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.121576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.121960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.122797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:05.125103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:05.228094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1104/2208] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:38:04 2022] POST /identity/v3/users => generated 286 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:38:05.232160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:05.242908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ab5f6-a483-4247-a4e2-fa0114d8a0c1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:05.247939 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:05.248933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.255329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.255329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.255329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:05.256344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:05.269042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1105/2209] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:38:05.272729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:05.284011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba98d50-25d7-4991-b5d2-ca3f35b04960 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:05.288933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0e2eb-6b7b-4f1b-a4ea-1a6d3f731522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:05.294490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0e2eb-6b7b-4f1b-a4ea-1a6d3f731522 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.294490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0e2eb-6b7b-4f1b-a4ea-1a6d3f731522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.294490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0e2eb-6b7b-4f1b-a4ea-1a6d3f731522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.294490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0e2eb-6b7b-4f1b-a4ea-1a6d3f731522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:05.294490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0e2eb-6b7b-4f1b-a4ea-1a6d3f731522 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:05.303543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1105/2210] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:38:05.307707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:05.328517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85858-69f2-4dc8-a95c-84a031bd3e33 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:05.333521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:05.334426 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.334706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.334985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] PATH_INFO: `/v3/projects/68fb0ff44aee4f67bb6d24f306424596/users/5415efb3e5e544b294a84f98d7b88498/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.369574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fb0ff44aee4f67bb6d24f306424596, user_id=5415efb3e5e544b294a84f98d7b88498, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:05.373895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:05.473271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1106/2211] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:38:05 2022] PUT /identity/v3/projects/68fb0ff44aee4f67bb6d24f306424596/users/5415efb3e5e544b294a84f98d7b88498/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:05.484738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.484738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.485120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.516830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] MFA Rules not processed for user `5415efb3e5e544b294a84f98d7b88498`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:05.518208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:05.596150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1106/2212] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:38:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:05.609655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:05.611590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:05.680251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18496471-043a-4df2-a3fa-7899140acf0d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:05.685280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba944ad6-11c4-40c9-8322-b172c73a2939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:05.686193 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944ad6-11c4-40c9-8322-b172c73a2939 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.686461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944ad6-11c4-40c9-8322-b172c73a2939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.686854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944ad6-11c4-40c9-8322-b172c73a2939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.697013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba944ad6-11c4-40c9-8322-b172c73a2939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:05.699508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba944ad6-11c4-40c9-8322-b172c73a2939 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:05.724211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1107/2213] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:05.747501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:05.836482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c7723-e871-4df4-abb7-4f7ad5268965 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:05.843626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:05.844988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:05.845272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:05.845553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] PATH_INFO: `/v3/users/5415efb3e5e544b294a84f98d7b88498` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:05.847034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5415efb3e5e544b294a84f98d7b88498)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:05.850106 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:05.856276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:05.975126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:06.088005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5415efb3e5e544b294a84f98d7b88498'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:06.091374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5415efb3e5e544b294a84f98d7b88498'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:06.190890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5415efb3e5e544b294a84f98d7b88498'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:06.200638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5415efb3e5e544b294a84f98d7b88498'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:06.201680 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5415efb3e5e544b294a84f98d7b88498'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:06.241470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1107/2214] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:38:05 2022] DELETE /identity/v3/users/5415efb3e5e544b294a84f98d7b88498 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:06.246170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:06.247214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:06.251212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:06.274499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:06.276071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:06.353434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1108/2215] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:06.364834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:06.368568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:06.471576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d68abe0-76bc-4c0a-8416-5531b44b28cb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:06.475464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7111a3-a295-488c-9d26-f166d50d379e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:06.476387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7111a3-a295-488c-9d26-f166d50d379e service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:06.476810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7111a3-a295-488c-9d26-f166d50d379e service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:06.477187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7111a3-a295-488c-9d26-f166d50d379e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:06.489381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7111a3-a295-488c-9d26-f166d50d379e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:06.490968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7111a3-a295-488c-9d26-f166d50d379e service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:06.502762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1108/2216] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:07.484470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:07.493780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:07.518428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b09e4-7156-43c8-8406-ecfe9dee2446 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:07.524670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:07.526331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:07.527344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:07.527787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] PATH_INFO: `/v3/projects/68fb0ff44aee4f67bb6d24f306424596` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:07.532355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fb0ff44aee4f67bb6d24f306424596)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:07.534734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:07.672951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fb0ff44aee4f67bb6d24f306424596', 'request_id': 'req-576058db-a287-4a01-8e18-ce79a5ca36c7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:07.679454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fb0ff44aee4f67bb6d24f306424596', 'request_id': 'req-576058db-a287-4a01-8e18-ce79a5ca36c7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:07.688645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fb0ff44aee4f67bb6d24f306424596', 'request_id': 'req-576058db-a287-4a01-8e18-ce79a5ca36c7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:08.150331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] The token cache is being invalidate because project 68fb0ff44aee4f67bb6d24f306424596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:38:08.150540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:08.151208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-576058db-a287-4a01-8e18-ce79a5ca36c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:08.152825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1109/2217] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:38:07 2022] DELETE /identity/v3/projects/68fb0ff44aee4f67bb6d24f306424596 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:16.498176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=68,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:18.147178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:19.524730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d372-6745-4934-940a-1ddaa08f3cf5 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:19.525295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d372-6745-4934-940a-1ddaa08f3cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:19.525509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6d372-6745-4934-940a-1ddaa08f3cf5 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:19.526760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1109/2218] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:38:19.533357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246d90-b44b-453a-8bb4-bbfe0cce0dd4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:19.533812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246d90-b44b-453a-8bb4-bbfe0cce0dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:19.533930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b246d90-b44b-453a-8bb4-bbfe0cce0dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:19.590390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6b246d90-b44b-453a-8bb4-bbfe0cce0dd4 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:19.591485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6b246d90-b44b-453a-8bb4-bbfe0cce0dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:19.675406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1110/2219] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:19.687304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6d372-6745-4934-940a-1ddaa08f3cf5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:19.689230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a3c6d372-6745-4934-940a-1ddaa08f3cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:19.755501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6d372-6745-4934-940a-1ddaa08f3cf5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:19.759185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd80b-e5ca-4766-864a-fbac57a212ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:19.759925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd80b-e5ca-4766-864a-fbac57a212ad service glance] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:19.760207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd80b-e5ca-4766-864a-fbac57a212ad service glance] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:19.760484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd80b-e5ca-4766-864a-fbac57a212ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:19.771216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd80b-e5ca-4766-864a-fbac57a212ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:19.772660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cd80b-e5ca-4766-864a-fbac57a212ad service glance] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:19.785164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1110/2220] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:19.941331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da66f2-4fac-4901-bd5e-d070093c17e1 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:19.941619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da66f2-4fac-4901-bd5e-d070093c17e1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:19.941899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da66f2-4fac-4901-bd5e-d070093c17e1 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:19.943264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1111/2221] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:38:19.947897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4441-be41-4def-ad23-1ab598f8bad5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:19.948190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4441-be41-4def-ad23-1ab598f8bad5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:19.948476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb4441-be41-4def-ad23-1ab598f8bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:19.969209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3fbb4441-be41-4def-ad23-1ab598f8bad5 None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:19.970487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3fbb4441-be41-4def-ad23-1ab598f8bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:20.020601 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1111/2222] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:38:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:20.033160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da66f2-4fac-4901-bd5e-d070093c17e1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:20.034868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-48da66f2-4fac-4901-bd5e-d070093c17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:20.048736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da66f2-4fac-4901-bd5e-d070093c17e1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:20.052752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75925-8b43-4ea1-8816-d28b59533f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:20.053404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75925-8b43-4ea1-8816-d28b59533f54 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:20.053963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75925-8b43-4ea1-8816-d28b59533f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:20.053963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75925-8b43-4ea1-8816-d28b59533f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:20.061899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75925-8b43-4ea1-8816-d28b59533f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:20.063428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75925-8b43-4ea1-8816-d28b59533f54 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:20.071354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1112/2223] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:20.152482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f17653-2d09-484e-a614-01767159f59b None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:20.152884 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f17653-2d09-484e-a614-01767159f59b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:20.153665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f17653-2d09-484e-a614-01767159f59b None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:20.155261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1112/2224] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:38:20.161683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d586bb3-9601-42b1-b691-1d10ac7366f6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:20.161987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d586bb3-9601-42b1-b691-1d10ac7366f6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:20.162273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d586bb3-9601-42b1-b691-1d10ac7366f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:20.180748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0d586bb3-9601-42b1-b691-1d10ac7366f6 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:20.181947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0d586bb3-9601-42b1-b691-1d10ac7366f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:20.192314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1113/2225] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:38:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:20.203921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f17653-2d09-484e-a614-01767159f59b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:20.214970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f17653-2d09-484e-a614-01767159f59b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:20.221126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:20.221763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:20.222046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:20.222323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:20.232830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:20.234248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:20.244962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1113/2226] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:24.754433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0ea7-4f90-47b6-b98d-fb0887bb1d50 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:24.754816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0ea7-4f90-47b6-b98d-fb0887bb1d50 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:24.755022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc0ea7-4f90-47b6-b98d-fb0887bb1d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:24.774221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-afbc0ea7-4f90-47b6-b98d-fb0887bb1d50 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:24.775453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-afbc0ea7-4f90-47b6-b98d-fb0887bb1d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:24.832692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1114/2227] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:38:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:24.846156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:24.846156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:24.920050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b30c-06fc-4d0d-a746-1e268ea46704 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:24.925076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:24.925716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:24.926002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:24.926279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:24.934346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:24.937893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:24.944344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1114/2228] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:38:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:38:25.028117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ce5c-2017-421f-89b3-e6c942972fb8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:25.028404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ce5c-2017-421f-89b3-e6c942972fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:25.028744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ce5c-2017-421f-89b3-e6c942972fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:25.046217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4a28ce5c-2017-421f-89b3-e6c942972fb8 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:25.047398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4a28ce5c-2017-421f-89b3-e6c942972fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:25.054584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1115/2229] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:38:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:25.073139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:25.078517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420b8f4-7173-405c-931c-eb521c3b691b service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:25.083677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:25.084306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:25.084594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:25.084903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:25.093030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:25.094578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:25.102827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1115/2230] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:38:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:38:26.239390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2fa69-915b-4bad-980b-8b00311d0603 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:26.239912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2fa69-915b-4bad-980b-8b00311d0603 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:26.240418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2fa69-915b-4bad-980b-8b00311d0603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:26.260517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-caa2fa69-915b-4bad-980b-8b00311d0603 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:26.261740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-caa2fa69-915b-4bad-980b-8b00311d0603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:26.270022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1116/2231] 10.222.0.65 () {58 vars in 967 bytes} [Thu Jun 16 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:26.283840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:26.294670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295ec6-5d1b-45d9-ae62-2f14b8c945a6 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:26.300162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:26.300990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:26.301374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:26.301768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:26.311452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:26.313134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:26.322147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1116/2232] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:38:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:38:26.964566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7290f-b4e5-4e2f-b3f8-3f778fdb6577 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:26.964899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7290f-b4e5-4e2f-b3f8-3f778fdb6577 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:26.965184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7290f-b4e5-4e2f-b3f8-3f778fdb6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:27.006145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:27.021660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-f5a7290f-b4e5-4e2f-b3f8-3f778fdb6577 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:27.022911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f5a7290f-b4e5-4e2f-b3f8-3f778fdb6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:27.043333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1117/2233] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:38:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:27.058180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:27.064068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:27.080317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1cdf5-0df9-4ee8-a89f-2e81c799199e service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:27.085451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:27.086099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:27.086384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:27.086665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:27.095275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:27.096890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:27.105939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1117/2234] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 20:38:27.921641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:27.922253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:27.922253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:27.947004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:27.948517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:27.959347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1118/2235] 10.222.0.65 () {58 vars in 967 bytes} [Thu Jun 16 20:38:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:27.981861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:27.994537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50a316-cc5b-4df9-9e81-0b2983e26c17 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:28.001401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d0e0e-29fa-4413-b59b-d1d1e9fb363a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:28.002233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0e0e-29fa-4413-b59b-d1d1e9fb363a service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:28.002623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0e0e-29fa-4413-b59b-d1d1e9fb363a service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:28.003006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d0e0e-29fa-4413-b59b-d1d1e9fb363a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:28.013104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d0e0e-29fa-4413-b59b-d1d1e9fb363a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:28.014699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d0e0e-29fa-4413-b59b-d1d1e9fb363a service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:28.023723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1118/2236] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:38:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:38:31.467480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:31.468974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:31.572600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d875f8-6aa7-47fb-9a78-346568083991 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:31.578718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:31.579902 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:31.580362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:31.580941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] PATH_INFO: `/v3/users/cc21914218b347898f0c94642c8ea984` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:31.582579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc21914218b347898f0c94642c8ea984)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:31.584802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:31.796901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc21914218b347898f0c94642c8ea984'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:31.809910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc21914218b347898f0c94642c8ea984'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:31.811243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc21914218b347898f0c94642c8ea984'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:31.821783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc21914218b347898f0c94642c8ea984'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:31.905251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc21914218b347898f0c94642c8ea984'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:31.911894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1119/2237] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:38:31 2022] DELETE /identity/v3/users/cc21914218b347898f0c94642c8ea984 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:31.916375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:31.916956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:31.916956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:31.937299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:31.938782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:32.005545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1119/2238] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:32.016684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:32.018099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:32.080301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46951245-44f4-467e-ad6b-e223d5a1c556 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:32.084058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923e6f-c17c-446a-b610-732abe8ed417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:32.084783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923e6f-c17c-446a-b610-732abe8ed417 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:32.085068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923e6f-c17c-446a-b610-732abe8ed417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:32.085345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923e6f-c17c-446a-b610-732abe8ed417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:32.095117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923e6f-c17c-446a-b610-732abe8ed417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:32.096568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923e6f-c17c-446a-b610-732abe8ed417 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:32.102306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:32.108034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1120/2239] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:32.374484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:32.376464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:32.393370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09258879-53a2-45b9-9b5c-b4890395c617 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:32.399013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:32.399902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:32.400176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:32.400443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] PATH_INFO: `/v3/projects/b04e4151d8864eeb92e4c7725290ca8d` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:32.401689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04e4151d8864eeb92e4c7725290ca8d)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:32.403696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:32.524483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04e4151d8864eeb92e4c7725290ca8d', 'request_id': 'req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:32.533138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04e4151d8864eeb92e4c7725290ca8d', 'request_id': 'req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:32.617812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04e4151d8864eeb92e4c7725290ca8d', 'request_id': 'req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:32.629558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] The token cache is being invalidate because project b04e4151d8864eeb92e4c7725290ca8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:38:32.629847 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:32.630503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:38:32.632062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1120/2240] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:38:32 2022] DELETE /identity/v3/projects/b04e4151d8864eeb92e4c7725290ca8d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:38:42.626344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:43.882830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:43.883355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:43.883445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:43.901242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:38:43.902442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:43.962372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1121/2241] 10.222.0.65 () {58 vars in 967 bytes} [Thu Jun 16 20:38:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:38:43.974904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:43.976392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:44.058693 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcd3b0-c094-48f6-9e5a-bb460b67e304 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:44.064256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e929b-b066-4c8e-a4a8-0b0203cfe384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:44.065040 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e929b-b066-4c8e-a4a8-0b0203cfe384 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:44.065323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e929b-b066-4c8e-a4a8-0b0203cfe384 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:44.065599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e929b-b066-4c8e-a4a8-0b0203cfe384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:44.073764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e929b-b066-4c8e-a4a8-0b0203cfe384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:44.075629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e929b-b066-4c8e-a4a8-0b0203cfe384 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:44.084397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1121/2242] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:38:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:38:46.147624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:38:46.149039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:46.240311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5c3cf-681b-46e2-8b70-249e71b96801 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:38:46.245352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:38:46.245991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:38:46.246269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:38:46.246540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:38:46.248265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:38:46.259725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:38:46.261546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89cda6-0e41-45e2-a2cf-7d3efd26cab0 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:38:46.271023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1122/2243] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:38:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:38:54.081151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=37 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:38:56.266982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=66 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:39:12.095758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e5e30-1f2b-4df7-8fe4-cc4e6023c7ea None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:39:12.096287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e5e30-1f2b-4df7-8fe4-cc4e6023c7ea None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:39:12.096287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e5e30-1f2b-4df7-8fe4-cc4e6023c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:39:12.123293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9f9e5e30-1f2b-4df7-8fe4-cc4e6023c7ea None None] MFA Rules not processed for user `58be610f6adc46269a46db36f41d6b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:39:12.125934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9f9e5e30-1f2b-4df7-8fe4-cc4e6023c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:39:12.182660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1122/2244] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:39:12.571294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f43af-6d0d-4ac9-b9ad-6bc9f2335d72 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:39:12.571873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f43af-6d0d-4ac9-b9ad-6bc9f2335d72 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:39:12.571873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f43af-6d0d-4ac9-b9ad-6bc9f2335d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:39:12.589397 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1c7f43af-6d0d-4ac9-b9ad-6bc9f2335d72 None None] MFA Rules not processed for user `e1b1a5aa634d40709b14bd2f7355a850`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:39:12.590602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1c7f43af-6d0d-4ac9-b9ad-6bc9f2335d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:39:12.645364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1123/2245] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:39:22.175822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=25 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:39:22.638296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=25 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:39:29.804186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:39:29.804999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:39:29.804999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:39:29.846113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] MFA Rules not processed for user `3edd15e5a774477d91c721251e61f5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:39:29.846113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:39:29.909869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1123/2246] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:39:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:39:39.902115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=25 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:39:48.853890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:39:48.854382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:39:48.854491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:39:48.872143 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] MFA Rules not processed for user `7926fb5f95ef4b6e894b7dac7f91625a`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:39:48.873861 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:39:48.939519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1124/2247] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:39:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:39:58.932343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=25 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:19.861051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:19.862789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:19.953630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c473a-1ab2-4386-b4d0-8ccd912913ef None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:19.958743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:19.959617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:19.961217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:19.961217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] PATH_INFO: `/v3/users/e1b1a5aa634d40709b14bd2f7355a850` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:19.961671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1b1a5aa634d40709b14bd2f7355a850)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:19.963470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:20.145865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1b1a5aa634d40709b14bd2f7355a850'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.146453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1b1a5aa634d40709b14bd2f7355a850'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.238102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1b1a5aa634d40709b14bd2f7355a850'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.245541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1b1a5aa634d40709b14bd2f7355a850'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.247177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fc7619c1-8179-4eaf-a119-db152a853c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1b1a5aa634d40709b14bd2f7355a850'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.264451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1124/2248] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:19 2022] DELETE /identity/v3/users/e1b1a5aa634d40709b14bd2f7355a850 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:20.519774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:20.533002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72993374-f774-4c6d-aa6c-aed73d7bc480 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:20.594043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:20.594891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:20.595167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:20.595456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] PATH_INFO: `/v3/projects/79ef64387ef24e6eb4f1f31a0c521f17` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:20.596878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ef64387ef24e6eb4f1f31a0c521f17)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:20.598752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:20.723281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ef64387ef24e6eb4f1f31a0c521f17', 'request_id': 'req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.728677 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ef64387ef24e6eb4f1f31a0c521f17', 'request_id': 'req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.734756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ef64387ef24e6eb4f1f31a0c521f17', 'request_id': 'req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.803251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] The token cache is being invalidate because project 79ef64387ef24e6eb4f1f31a0c521f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:20.803542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.804192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a8aa855-9c58-485b-b2b1-a57c3dcc752a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:20.805755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1125/2249] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:20 2022] DELETE /identity/v3/projects/79ef64387ef24e6eb4f1f31a0c521f17 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:20.818362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:20.818362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:20.818362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:20.836849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:20.838047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:20.897923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1125/2250] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:20.906584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:20.906906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:20.907376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:20.925864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:20.927087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:20.935649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1126/2251] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:20.939921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:20.950126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2835c49a-3f13-4be1-89a2-3b9a02e18cbc None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:20.955577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:20.956260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:20.956538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:20.956847 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:20.957571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:40:20.957872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:20.959451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:20.971481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1126/2252] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:40:20.975881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:20.985695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127dd84-7c46-4324-8acd-22ec8b5bb869 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:20.990306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:20.990950 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:20.991228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:20.991527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:20.992210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:20.994134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.090814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1127/2253] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:20 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:21.094870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.104871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633af054-c205-4208-bce9-a3e19fcd8dad admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.108974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:21.167396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.168334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.168637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.168917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.170248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.172138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.280468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1127/2254] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:21 2022] POST /identity/v3/users => generated 303 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:21.284473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.295599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123a93d-99da-4c41-a6ed-0e89638d38ae admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.300312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.301005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.301329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.306759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.306759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.306759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.315507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1128/2255] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:21.319338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.329498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf575570-aa1b-492a-92e2-b7a4a60996bb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.334033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd6530-89dc-45cc-9aaf-33ed2a7b8740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.334678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd6530-89dc-45cc-9aaf-33ed2a7b8740 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.335113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd6530-89dc-45cc-9aaf-33ed2a7b8740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.336183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd6530-89dc-45cc-9aaf-33ed2a7b8740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.337132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd6530-89dc-45cc-9aaf-33ed2a7b8740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.338728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd6530-89dc-45cc-9aaf-33ed2a7b8740 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.349388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1128/2256] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:40:21.353422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.365129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619214ac-6d82-41b3-972c-48b9e6940116 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.369673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.370542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.370819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.371235 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] PATH_INFO: `/v3/projects/195b01bb64d247fd8e4db6b4bc5a8cb8/users/c12a720082e94a0396701ea19c248331/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.388265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=195b01bb64d247fd8e4db6b4bc5a8cb8, user_id=c12a720082e94a0396701ea19c248331, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.391389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.486722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1129/2257] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:21 2022] PUT /identity/v3/projects/195b01bb64d247fd8e4db6b4bc5a8cb8/users/c12a720082e94a0396701ea19c248331/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:21.496715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.497008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.497341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.522950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] MFA Rules not processed for user `c12a720082e94a0396701ea19c248331`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:21.524130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:21.597479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1129/2258] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:21.607751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.632571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:21.667597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f23d7-08b8-4f69-a1f9-0f2d6e1ed58c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.672783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.673492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.673771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.674042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.674792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.676766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.792645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1130/2259] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:21 2022] POST /identity/v3/projects => generated 405 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:21.796058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.806553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2899761-f414-4c19-8c93-53fa90d68adf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.862970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.863586 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.863872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.864151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.864889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.866790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:21.977656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1130/2260] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:21 2022] POST /identity/v3/users => generated 309 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:21.980073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:21.990626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff6e3a-9bcf-4abe-814d-92ac8e7aad83 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:21.995268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:21.995921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:21.996204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:21.996482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:21.997302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:21.999447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:22.010993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1131/2261] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:22.017934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:22.024217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:22.027924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d258-5271-469a-9080-82f3d4b06051 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:22.033181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:22.034070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:22.034354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:22.034633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] PATH_INFO: `/v3/projects/279727a1ea5f439e939f39e873b119fa/users/3b40d1c3a0274800b3d96fecdbbdcbfe/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:22.050836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279727a1ea5f439e939f39e873b119fa, user_id=3b40d1c3a0274800b3d96fecdbbdcbfe, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:22.055118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:22.139151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1131/2262] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:22 2022] PUT /identity/v3/projects/279727a1ea5f439e939f39e873b119fa/users/3b40d1c3a0274800b3d96fecdbbdcbfe/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:22.146908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:22.153499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eae3e-bbda-4176-9b08-d20b7fb3dd6a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:22.209704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3de7d-19d8-48e4-9fb2-a800c78a0c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:22.210406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3de7d-19d8-48e4-9fb2-a800c78a0c1c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:22.210687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3de7d-19d8-48e4-9fb2-a800c78a0c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:22.210961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3de7d-19d8-48e4-9fb2-a800c78a0c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:22.211680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3de7d-19d8-48e4-9fb2-a800c78a0c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:22.213321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3de7d-19d8-48e4-9fb2-a800c78a0c1c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:22.223560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1132/2263] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:22.227518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:22.237907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abb0e7-1144-4fc8-a26f-d9ec1801fa08 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:22.242558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:22.243437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:22.243721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:22.244050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] PATH_INFO: `/v3/projects/279727a1ea5f439e939f39e873b119fa/users/3b40d1c3a0274800b3d96fecdbbdcbfe/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:22.246051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279727a1ea5f439e939f39e873b119fa, user_id=3b40d1c3a0274800b3d96fecdbbdcbfe, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:22.250553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:22.259870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1132/2264] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:22 2022] PUT /identity/v3/projects/279727a1ea5f439e939f39e873b119fa/users/3b40d1c3a0274800b3d96fecdbbdcbfe/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:22.271004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:22.271325 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:22.271603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:22.298006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] MFA Rules not processed for user `3b40d1c3a0274800b3d96fecdbbdcbfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:22.299207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:22.365505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1133/2265] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:22.377795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:22.382439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:22.462431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a9e57-e0c7-4f9f-a5ba-87f90441d553 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:22.468742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9115a7-976a-4317-aa31-77832215f0ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:22.478474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9115a7-976a-4317-aa31-77832215f0ce service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:22.478474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9115a7-976a-4317-aa31-77832215f0ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:22.478474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9115a7-976a-4317-aa31-77832215f0ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:22.485061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9115a7-976a-4317-aa31-77832215f0ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:22.486696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9115a7-976a-4317-aa31-77832215f0ce service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:22.498506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1133/2266] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:22 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:22.637776 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:22.663510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:22.701976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3196f-59fc-4135-8fb0-ef6483ffbfc8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:22.706530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:22.708825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:22.708825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:22.708825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] PATH_INFO: `/v3/users/c12a720082e94a0396701ea19c248331` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:22.709151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12a720082e94a0396701ea19c248331)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:22.711084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:22.898827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12a720082e94a0396701ea19c248331'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:22.911994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12a720082e94a0396701ea19c248331'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:22.912794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12a720082e94a0396701ea19c248331'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:22.925493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12a720082e94a0396701ea19c248331'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:22.989904 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12a720082e94a0396701ea19c248331'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:22.996585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1134/2267] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:22 2022] DELETE /identity/v3/users/c12a720082e94a0396701ea19c248331 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:23.001266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:23.001724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:23.001955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:23.019321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:23.020517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:23.092272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1134/2268] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:23.098959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:23.100579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:23.159425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624f3ee-00b1-47dc-8379-0b49c3f8c21d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:23.163177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9745-9464-4eeb-9094-0b9b36ec71e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:23.163820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9745-9464-4eeb-9094-0b9b36ec71e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:23.164101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9745-9464-4eeb-9094-0b9b36ec71e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:23.164393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9745-9464-4eeb-9094-0b9b36ec71e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:23.174264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d9745-9464-4eeb-9094-0b9b36ec71e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:23.179151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d9745-9464-4eeb-9094-0b9b36ec71e6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:23.187427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1135/2269] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:23.996234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:23.998990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:24.011246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a015dae-1d01-408c-b056-ed817cdc98df None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:24.022936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:24.022936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:24.022936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:24.022936 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] PATH_INFO: `/v3/projects/195b01bb64d247fd8e4db6b4bc5a8cb8` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:24.023257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195b01bb64d247fd8e4db6b4bc5a8cb8)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:24.023349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:24.158499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:24.161539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195b01bb64d247fd8e4db6b4bc5a8cb8', 'request_id': 'req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.167794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195b01bb64d247fd8e4db6b4bc5a8cb8', 'request_id': 'req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.234375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195b01bb64d247fd8e4db6b4bc5a8cb8', 'request_id': 'req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.245081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] The token cache is being invalidate because project 195b01bb64d247fd8e4db6b4bc5a8cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:24.245377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.246033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.247947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:24.248483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:24.248577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1135/2270] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:23 2022] DELETE /identity/v3/projects/195b01bb64d247fd8e4db6b4bc5a8cb8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:24.248718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:24.251892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:24.253228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:24.266652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] MFA Rules not processed for user `58be610f6adc46269a46db36f41d6b25`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:24.268088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:24.309190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:24.317347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f4b373-d62a-4cd6-8e89-da68a5ba05f1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:24.321972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:24.322833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:24.323136 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:24.323414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] PATH_INFO: `/v3/users/3b40d1c3a0274800b3d96fecdbbdcbfe` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:24.324962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b40d1c3a0274800b3d96fecdbbdcbfe)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:24.325132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1136/2271] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:40:24.327057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:24.516014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b40d1c3a0274800b3d96fecdbbdcbfe'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.516771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b40d1c3a0274800b3d96fecdbbdcbfe'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.581367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b40d1c3a0274800b3d96fecdbbdcbfe'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.589389 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b40d1c3a0274800b3d96fecdbbdcbfe'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.590110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-8161d7eb-644e-4cec-895f-cc7dab333e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b40d1c3a0274800b3d96fecdbbdcbfe'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:24.609571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1136/2272] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:24 2022] DELETE /identity/v3/users/3b40d1c3a0274800b3d96fecdbbdcbfe => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:40:25.163350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:25.175059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2a967-3a89-45cb-a615-d1bf8685fcdf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:25.236376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:25.237284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.237566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.237841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] PATH_INFO: `/v3/projects/279727a1ea5f439e939f39e873b119fa` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.239044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=279727a1ea5f439e939f39e873b119fa)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:25.241254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:25.350373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279727a1ea5f439e939f39e873b119fa', 'request_id': 'req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:25.356177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279727a1ea5f439e939f39e873b119fa', 'request_id': 'req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:25.376134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279727a1ea5f439e939f39e873b119fa', 'request_id': 'req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:25.451372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] The token cache is being invalidate because project 279727a1ea5f439e939f39e873b119fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:25.451888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:25.452695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-878cfe9e-a6a7-4379-abb0-5c99e97a5e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:25.454534 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1137/2273] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:25 2022] DELETE /identity/v3/projects/279727a1ea5f439e939f39e873b119fa => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:25.459208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.459662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.459793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.479300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:25.480641 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:25.529139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:25.540708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1137/2274] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:25.548525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.548843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.549127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.568977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:25.570322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:25.579464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1138/2275] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:25.583850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:25.595844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6c0c-708c-47b1-80bb-2f197288615f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:25.602053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:25.603191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.606333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.606333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.606333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:40:25.606333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:25.608798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:25.636515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1138/2276] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:40:25.636827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:25.638478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1f504-8deb-49a1-b8a7-5f504341b23b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:25.643633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:25.644399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.644784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.645125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.645888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:25.647983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:25.771277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1139/2277] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:25 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:40:25.775400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:25.785354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfe4ef-d27b-4c01-8104-0e114dde01d0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:25.840569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:25.841292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.841575 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.841854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.842576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:25.844479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:25.935499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1139/2278] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:25 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:25.939403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:25.950212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce9924-2096-42fb-941a-fda946d4d6bb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:25.954835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:25.955481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.955764 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.956038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.956805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:25.958443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:25.970689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1140/2279] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:25.974564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:25.985394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bfa464-c220-4d7c-b990-4b0c206d14c2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:25.990021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545881-64bf-4935-9c41-696ecb315ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:25.990666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545881-64bf-4935-9c41-696ecb315ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:25.990972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545881-64bf-4935-9c41-696ecb315ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:25.991225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545881-64bf-4935-9c41-696ecb315ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:25.991950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545881-64bf-4935-9c41-696ecb315ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:25.993561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1545881-64bf-4935-9c41-696ecb315ee7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.003270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1140/2280] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:26.007435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.017361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb1ba2-db83-490b-9858-356186f998af admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.022072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.022933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.023218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.023490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] PATH_INFO: `/v3/projects/b44711a5626246a98adead0bdec4ee88/users/0eb971efe6874cc0a54b6f2bf369b8ca/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.038403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b44711a5626246a98adead0bdec4ee88, user_id=0eb971efe6874cc0a54b6f2bf369b8ca, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.041274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.120345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1141/2281] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:26 2022] PUT /identity/v3/projects/b44711a5626246a98adead0bdec4ee88/users/0eb971efe6874cc0a54b6f2bf369b8ca/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:26.130806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.131103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.131382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.160636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] MFA Rules not processed for user `0eb971efe6874cc0a54b6f2bf369b8ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:26.161849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:26.231990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1141/2282] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:26.236465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.254023 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:26.299506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf32046-dac7-4f6c-b419-ab060aad7651 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.304222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.304903 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.305187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.305462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.306197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.308054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.391048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1142/2283] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:26 2022] POST /identity/v3/projects => generated 365 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:26.395159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.406339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ba28-a94b-48b9-82d8-f099e0d990b9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.451721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:26.463412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.466846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.466846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.466846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.466846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.467229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.568028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1142/2284] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:26 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:26.572113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.626046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f438869-bc8c-4a73-a6d4-97a50ce8b5ef admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.630855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.631554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.631835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.632109 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.632878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.634465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.645376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1143/2285] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:26.649695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.660175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75890ce-49dc-4ead-aa24-d7fc8489a989 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.664784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.665675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.665982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.666281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] PATH_INFO: `/v3/projects/79c44c6430b3457187ed47d004bfb90b/users/899dee1edfbe49148d715b119436fb89/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.685947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c44c6430b3457187ed47d004bfb90b, user_id=899dee1edfbe49148d715b119436fb89, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.688698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.784673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1143/2286] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:26 2022] PUT /identity/v3/projects/79c44c6430b3457187ed47d004bfb90b/users/899dee1edfbe49148d715b119436fb89/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:40:26.788536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.799082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcbf02-57b3-41e7-b407-c1486a9f0b70 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.854987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccdb4c-726f-4e83-b8eb-9cb0c56b6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.855637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccdb4c-726f-4e83-b8eb-9cb0c56b6339 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.855913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccdb4c-726f-4e83-b8eb-9cb0c56b6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.856834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccdb4c-726f-4e83-b8eb-9cb0c56b6339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.857520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccdb4c-726f-4e83-b8eb-9cb0c56b6339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.859101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccdb4c-726f-4e83-b8eb-9cb0c56b6339 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.869268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1144/2287] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:26.873078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:26.883362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc0d22-99c5-4213-8488-1634e3332c94 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:26.888003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:26.888937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.889224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.889506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] PATH_INFO: `/v3/projects/79c44c6430b3457187ed47d004bfb90b/users/899dee1edfbe49148d715b119436fb89/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.891514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c44c6430b3457187ed47d004bfb90b, user_id=899dee1edfbe49148d715b119436fb89, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:26.894186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:26.905681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1144/2288] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:26 2022] PUT /identity/v3/projects/79c44c6430b3457187ed47d004bfb90b/users/899dee1edfbe49148d715b119436fb89/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:26.917011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:26.917136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:26.917353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:26.946942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] MFA Rules not processed for user `899dee1edfbe49148d715b119436fb89`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:26.948225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:27.016069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1145/2289] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:27.027464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:27.029713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:27.086587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c982c-56a5-4e15-b482-7fa4d6b431a9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:27.090240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:27.097224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:27.097224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:27.097224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:27.100802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:27.102220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:27.111500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1145/2290] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:27.348385 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:27.358693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e4865a-ffed-4848-bdb1-2ade61e955cf None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:27.362951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef21e4-81b6-4b67-9e3e-e6242030ac37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:27.363603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef21e4-81b6-4b67-9e3e-e6242030ac37 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:27.363880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef21e4-81b6-4b67-9e3e-e6242030ac37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:27.364155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef21e4-81b6-4b67-9e3e-e6242030ac37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:27.374173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:27.426088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef21e4-81b6-4b67-9e3e-e6242030ac37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:27.427662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef21e4-81b6-4b67-9e3e-e6242030ac37 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:27.438123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1146/2291] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:27 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:36.271170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:36.334428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d8e254-ac6d-4499-b600-d151d2e21d34 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:36.338998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:36.339864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:36.340141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:36.340411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] PATH_INFO: `/v3/users/0eb971efe6874cc0a54b6f2bf369b8ca` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:36.342951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eb971efe6874cc0a54b6f2bf369b8ca)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:36.344894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:36.514560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:36.516004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eb971efe6874cc0a54b6f2bf369b8ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:36.516675 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eb971efe6874cc0a54b6f2bf369b8ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:36.631793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eb971efe6874cc0a54b6f2bf369b8ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:36.639288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eb971efe6874cc0a54b6f2bf369b8ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:36.641719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eb971efe6874cc0a54b6f2bf369b8ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:36.657657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1146/2292] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:36 2022] DELETE /identity/v3/users/0eb971efe6874cc0a54b6f2bf369b8ca => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:36.661867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:36.662383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:36.662487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:36.682681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:36.694189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:36.753579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1147/2293] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:36.763827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:36.765354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:36.822310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cf5cb-ae91-4a28-a1ac-2fe4258e09e0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:36.826819 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:36.827470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:36.828158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:36.828351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:36.837835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:36.839718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:36.849793 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1147/2294] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:37.280850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:37.282460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:37.295347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25bd12-893b-45c7-b836-65d990367348 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:37.300232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:37.301223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:37.301591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:37.302052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] PATH_INFO: `/v3/projects/b44711a5626246a98adead0bdec4ee88` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:37.303394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b44711a5626246a98adead0bdec4ee88)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:37.305402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:37.421085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b44711a5626246a98adead0bdec4ee88', 'request_id': 'req-eefcc39e-d3f8-45af-b055-90e05581f20e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.426774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b44711a5626246a98adead0bdec4ee88', 'request_id': 'req-eefcc39e-d3f8-45af-b055-90e05581f20e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.432976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b44711a5626246a98adead0bdec4ee88', 'request_id': 'req-eefcc39e-d3f8-45af-b055-90e05581f20e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.507528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] The token cache is being invalidate because project b44711a5626246a98adead0bdec4ee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:37.507816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.508444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.510046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1148/2295] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:37 2022] DELETE /identity/v3/projects/b44711a5626246a98adead0bdec4ee88 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:37.514123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:37.525784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431accb3-a31a-4ff3-97d8-fd741619b3f5 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:37.601257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:37.602225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:37.602510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:37.602799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] PATH_INFO: `/v3/users/899dee1edfbe49148d715b119436fb89` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:37.603964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=899dee1edfbe49148d715b119436fb89)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:37.606505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:37.791450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '899dee1edfbe49148d715b119436fb89'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.792080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '899dee1edfbe49148d715b119436fb89'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.858764 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '899dee1edfbe49148d715b119436fb89'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.864971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '899dee1edfbe49148d715b119436fb89'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.866448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7e976c0e-cb3c-426c-9981-0ea1dea9c162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '899dee1edfbe49148d715b119436fb89'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:37.870737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:37.884827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1148/2296] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:37 2022] DELETE /identity/v3/users/899dee1edfbe49148d715b119436fb89 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:38.273329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:38.274863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:38.297721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcc39e-d3f8-45af-b055-90e05581f20e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:38.333223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:38.361282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:38.362157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:38.362434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:38.362731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] PATH_INFO: `/v3/projects/79c44c6430b3457187ed47d004bfb90b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:38.363963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c44c6430b3457187ed47d004bfb90b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:38.366018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:38.467203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c44c6430b3457187ed47d004bfb90b', 'request_id': 'req-e3e0fb88-0800-4d54-a203-095f9d7622c0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:38.472674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c44c6430b3457187ed47d004bfb90b', 'request_id': 'req-e3e0fb88-0800-4d54-a203-095f9d7622c0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:38.479017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c44c6430b3457187ed47d004bfb90b', 'request_id': 'req-e3e0fb88-0800-4d54-a203-095f9d7622c0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:38.566646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] The token cache is being invalidate because project 79c44c6430b3457187ed47d004bfb90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:38.566923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:38.567555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e3e0fb88-0800-4d54-a203-095f9d7622c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:38.569204 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1149/2297] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:38 2022] DELETE /identity/v3/projects/79c44c6430b3457187ed47d004bfb90b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:38.574429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:38.575084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:38.575084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:38.593239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:38.594441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:38.662152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1149/2298] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:38.670489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:38.670783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:38.671071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:38.689550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:38.690968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:38.699197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1150/2299] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:38.703443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:38.713902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883208ff-d041-4aa9-95d4-d2758719b7ea None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:38.719046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:38.719754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:38.720029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:38.720418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:38.721183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:40:38.764337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:38.764337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:38.764337 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1150/2300] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:40:38.767540 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:38.776879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b94419-c2a4-492f-b09a-876293695712 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:38.782326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:38.782981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:38.783267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:38.783543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:38.784249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:38.786241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:38.880602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1151/2301] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:38 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:38.881443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:38.902149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd872e7-4046-41fc-88f2-3011a203e773 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:38.957930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:38.958591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:38.958873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:38.959153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:38.959839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:38.961766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.072285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1151/2302] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:38 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:40:39.077003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.087319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931945-9f86-47bd-8a63-6c15a0817e34 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.092846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.093537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.093820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.094097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.094827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.096492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.107796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1152/2303] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:39.111584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.121852 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0921-6caf-4a39-a976-22476e574b2f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.126630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c4c230-351b-4dfa-8813-a6a7dd76d05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.127289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c230-351b-4dfa-8813-a6a7dd76d05f admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.127576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c230-351b-4dfa-8813-a6a7dd76d05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.127856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c4c230-351b-4dfa-8813-a6a7dd76d05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.129262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c230-351b-4dfa-8813-a6a7dd76d05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.130861 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c4c230-351b-4dfa-8813-a6a7dd76d05f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.141921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1152/2304] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:39.146065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.156595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771d2e-dcdb-4044-9cec-dfc15eb9e5e5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.161197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.162080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.162362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.162634 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] PATH_INFO: `/v3/projects/d8ac1d1fd1f348158228f98f88cd8a73/users/90777ac0ba8e4036bf118d9195b6b093/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.177404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ac1d1fd1f348158228f98f88cd8a73, user_id=90777ac0ba8e4036bf118d9195b6b093, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.180051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.256919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1153/2305] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:39 2022] PUT /identity/v3/projects/d8ac1d1fd1f348158228f98f88cd8a73/users/90777ac0ba8e4036bf118d9195b6b093/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:39.267894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.272767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.272767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.296292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] MFA Rules not processed for user `90777ac0ba8e4036bf118d9195b6b093`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:39.297528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:39.338444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:39.363087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1153/2306] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:39.367795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.463789 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d00c71-3730-467f-ab20-f0caf94c0295 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.469122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.469790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.470573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.470704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.471406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.473411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.484065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:39.563398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1154/2307] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:39 2022] POST /identity/v3/projects => generated 389 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:39.567433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.579776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a406c-0657-4030-b4ea-3d383e2ea121 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.653561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.654148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.654433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.654709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.655498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.657447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.747714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1154/2308] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:39 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:39.748588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.759004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c9d7-a42b-4925-a2be-4961d0a9ff89 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.764251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.769441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.769441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.769441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.769441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.769441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.791757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1155/2309] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:40:39.795355 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.806563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c82b-acaf-4515-9daa-e2e04d36b6b6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:39.815343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:39.815343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:39.815343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:39.816767 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] PATH_INFO: `/v3/projects/57b43dd541d8409998fd8a93278efc04/users/0e0280ec2e9941f09ef63fd15b43afa3/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:39.838488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b43dd541d8409998fd8a93278efc04, user_id=0e0280ec2e9941f09ef63fd15b43afa3, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:39.841444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:39.939752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1155/2310] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:39 2022] PUT /identity/v3/projects/57b43dd541d8409998fd8a93278efc04/users/0e0280ec2e9941f09ef63fd15b43afa3/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:39.943716 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:39.954459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc774d-8f74-42ab-8970-a52d650a8b27 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:40.021577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:40.022305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.022556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.022922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.024209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:40.025282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:40.040279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1156/2311] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:40.041656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:40.061567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2905f-c853-44f6-a6d9-492c78b0d6b4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:40.067898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab143f-cc44-4a89-8696-d4d07a0090ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:40.069087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab143f-cc44-4a89-8696-d4d07a0090ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.069691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab143f-cc44-4a89-8696-d4d07a0090ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.070126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab143f-cc44-4a89-8696-d4d07a0090ee admin admin] PATH_INFO: `/v3/projects/57b43dd541d8409998fd8a93278efc04/users/0e0280ec2e9941f09ef63fd15b43afa3/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.073175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab143f-cc44-4a89-8696-d4d07a0090ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b43dd541d8409998fd8a93278efc04, user_id=0e0280ec2e9941f09ef63fd15b43afa3, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:40.076414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:40.079664 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:40.081947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab143f-cc44-4a89-8696-d4d07a0090ee admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:40.099563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1156/2312] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:40 2022] PUT /identity/v3/projects/57b43dd541d8409998fd8a93278efc04/users/0e0280ec2e9941f09ef63fd15b43afa3/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:40:40.111889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.112548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.113085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.148840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] MFA Rules not processed for user `0e0280ec2e9941f09ef63fd15b43afa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:40.150244 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:40.154576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f74f76-25cc-485a-a318-2f0b614a9d2d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:40.216044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:40.216530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.217560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.217836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.220208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:40.253870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1157/2313] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:40:40.264053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:40.264483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:40.265875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:40.288974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:40.298051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:40.299668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:40.311941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1157/2314] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:40:40.329564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e567e00-63d9-42d7-9b4e-8d89b1f80c84 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:40.333192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b507f-2bff-4e1e-adaf-6684354767dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:40.333842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b507f-2bff-4e1e-adaf-6684354767dd service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.334121 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b507f-2bff-4e1e-adaf-6684354767dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.334391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b507f-2bff-4e1e-adaf-6684354767dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.344587 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b507f-2bff-4e1e-adaf-6684354767dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:40.349714 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b507f-2bff-4e1e-adaf-6684354767dd service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:40.368752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1158/2315] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:40:40.554868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:40.619282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c60fab-ef41-41f2-b631-a9e710134f25 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:40.623876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:40.624865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.625494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.625779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] PATH_INFO: `/v3/users/90777ac0ba8e4036bf118d9195b6b093` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.627016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90777ac0ba8e4036bf118d9195b6b093)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:40.629106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:40.850684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90777ac0ba8e4036bf118d9195b6b093'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:40.862863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90777ac0ba8e4036bf118d9195b6b093'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:40.863525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90777ac0ba8e4036bf118d9195b6b093'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:40.870117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90777ac0ba8e4036bf118d9195b6b093'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:40.959149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90777ac0ba8e4036bf118d9195b6b093'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:40.966354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1158/2316] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:40 2022] DELETE /identity/v3/users/90777ac0ba8e4036bf118d9195b6b093 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:40.970997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:40.971464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:40.971582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:40.989480 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:40.990709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:41.048597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1159/2317] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:41.058258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:41.059652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:41.113322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:41.118493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5a5fd-6960-433a-b57e-0e33b3614287 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:41.122153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:41.125249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:41.125249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:41.125249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:41.133643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:41.136714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:41.147080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1159/2318] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:41.460306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:41.469823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23f827-7da7-4d2d-bf8a-d0a8548149f1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:41.473351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:41.473985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:41.474267 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:41.474543 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:41.476318 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:41.551072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:41.553493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:41.574220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:41.575784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:41.581854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1160/2319] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:41.615871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0b33a-9f2c-4c46-ae5a-79828cd928b8 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:41.622205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:41.623185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:41.623526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:41.623869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] PATH_INFO: `/v3/projects/d8ac1d1fd1f348158228f98f88cd8a73` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:41.625312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ac1d1fd1f348158228f98f88cd8a73)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:41.627473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:41.768845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ac1d1fd1f348158228f98f88cd8a73', 'request_id': 'req-d7739172-6631-472c-b65c-fcfcc6b638f0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:41.774150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ac1d1fd1f348158228f98f88cd8a73', 'request_id': 'req-d7739172-6631-472c-b65c-fcfcc6b638f0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:41.780836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ac1d1fd1f348158228f98f88cd8a73', 'request_id': 'req-d7739172-6631-472c-b65c-fcfcc6b638f0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:41.854247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] The token cache is being invalidate because project d8ac1d1fd1f348158228f98f88cd8a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:41.854528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:41.855127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:41.857462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1160/2320] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:41 2022] DELETE /identity/v3/projects/d8ac1d1fd1f348158228f98f88cd8a73 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:40:41.861533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:41.872187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326be34-f423-45ab-bad3-a04fcf6906d6 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:41.917190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:41.930812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:41.931672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:41.931949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:41.932218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] PATH_INFO: `/v3/users/0e0280ec2e9941f09ef63fd15b43afa3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:41.933444 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0280ec2e9941f09ef63fd15b43afa3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:41.935376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:42.175670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0280ec2e9941f09ef63fd15b43afa3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.176333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0280ec2e9941f09ef63fd15b43afa3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.265306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0280ec2e9941f09ef63fd15b43afa3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.272624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0280ec2e9941f09ef63fd15b43afa3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.273263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-6741adbc-6d70-4f54-8958-2bf8b2dd91b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0280ec2e9941f09ef63fd15b43afa3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.290984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1161/2321] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:41 2022] DELETE /identity/v3/users/0e0280ec2e9941f09ef63fd15b43afa3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:42.761591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:42.763080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:42.776282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7739172-6631-472c-b65c-fcfcc6b638f0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:42.864349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:42.865261 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:42.865543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:42.865819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] PATH_INFO: `/v3/projects/57b43dd541d8409998fd8a93278efc04` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:42.867117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b43dd541d8409998fd8a93278efc04)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:42.869274 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:42.986483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b43dd541d8409998fd8a93278efc04', 'request_id': 'req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.991854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b43dd541d8409998fd8a93278efc04', 'request_id': 'req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:42.998478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b43dd541d8409998fd8a93278efc04', 'request_id': 'req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:43.089802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] The token cache is being invalidate because project 57b43dd541d8409998fd8a93278efc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:43.090089 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:43.090732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-30bbb5c7-fb3c-4d07-addd-4fa66b74c689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:43.092825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1161/2322] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:42 2022] DELETE /identity/v3/projects/57b43dd541d8409998fd8a93278efc04 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:43.097795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.098115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.098417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.117156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:43.118374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:43.177396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1162/2323] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:43.185302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.185600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.185876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.192288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:43.205036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:43.206219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:43.214192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1162/2324] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:43.218873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:43.228535 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad75098-54fd-4bcd-8141-0b126f6aaf16 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:43.233642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:43.234281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.234560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.234835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.235550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:40:43.235856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:43.237467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:43.249800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1163/2325] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:40:43.252908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:43.262340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f01b2-0736-4ac2-a28c-8618b37854f8 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:43.267008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:43.267846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.268301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.268967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.269706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:43.271582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:43.361509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1163/2326] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:43 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:43.365677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:43.375524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad685c8-fd89-4a96-a186-2d87fe20df64 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:43.432090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:43.441182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:43.441879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.442180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.444874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.444874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:43.445135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:43.549228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1164/2327] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:43 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:43.554368 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:43.564232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02d6f6-2ca4-4d68-8505-da9d878b2b79 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:43.568998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:43.569752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.570031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.570302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.571026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:43.572637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:43.584072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1164/2328] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:43.587921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:43.598961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3460399-f3b7-4ccd-b403-7e2c34f9633d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:43.604179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72091fd2-9de6-4ea1-9d99-604963bdcb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:43.604905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091fd2-9de6-4ea1-9d99-604963bdcb6e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.605189 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091fd2-9de6-4ea1-9d99-604963bdcb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.605460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72091fd2-9de6-4ea1-9d99-604963bdcb6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.606212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72091fd2-9de6-4ea1-9d99-604963bdcb6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:43.607811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72091fd2-9de6-4ea1-9d99-604963bdcb6e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:43.617949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1165/2329] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:43.622095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:43.632580 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677965a2-18c9-4197-bccb-9acd3e048a05 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:43.637347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:43.638840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.640295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.640295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] PATH_INFO: `/v3/projects/823dc554348a4fc4b613c5effe4fcf08/users/b6f4ea98013946eb9fc5156b9acb1a1e/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.655337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823dc554348a4fc4b613c5effe4fcf08, user_id=b6f4ea98013946eb9fc5156b9acb1a1e, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:43.658072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:43.784477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1165/2330] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:43 2022] PUT /identity/v3/projects/823dc554348a4fc4b613c5effe4fcf08/users/b6f4ea98013946eb9fc5156b9acb1a1e/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:43.795062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:43.795298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:43.795908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:43.832422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] MFA Rules not processed for user `b6f4ea98013946eb9fc5156b9acb1a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:43.835722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:43.912086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1166/2331] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:43.917087 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.018928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a83cd-483f-471e-8187-896fffa5ddc9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.024035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6d5b5-77fb-4844-96df-31b1f2a63b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.025222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6d5b5-77fb-4844-96df-31b1f2a63b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.025222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6d5b5-77fb-4844-96df-31b1f2a63b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.025422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6d5b5-77fb-4844-96df-31b1f2a63b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.025956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6d5b5-77fb-4844-96df-31b1f2a63b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.027859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6d5b5-77fb-4844-96df-31b1f2a63b6e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.176185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1166/2332] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:43 2022] POST /identity/v3/projects => generated 379 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:40:44.178288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.189284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0cb63-ec90-43eb-8624-248bdbcbb05c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.256897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.257583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.257870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.258151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.258880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.260865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.311566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.311876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.312156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.330704 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:44.331835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:44.376139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1167/2333] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:44 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:40:44.380842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.389873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1167/2334] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:40:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:40:44.391328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9e0e7-883c-4407-a0b6-0a82c9edf1e0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.396001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.396704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.397771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.397771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.398039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.399727 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.414278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1168/2335] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:40:44.417681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.429400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd23a-0c20-413e-8f00-fb32fb291209 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.433970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.435492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.435774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.436046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] PATH_INFO: `/v3/projects/bacaef28f5974df1a8a9d43703a1da45/users/7752ee54f41548fca3f518722520c16a/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.450863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacaef28f5974df1a8a9d43703a1da45, user_id=7752ee54f41548fca3f518722520c16a, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.453592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.519383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1168/2336] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:44 2022] PUT /identity/v3/projects/bacaef28f5974df1a8a9d43703a1da45/users/7752ee54f41548fca3f518722520c16a/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:44.526941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.527054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.527054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:44.533447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:44.533610 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8090501-f369-4bbe-9a4d-06a2576cfa1c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.580585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:44.601520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.602186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.602473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.602749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.603478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.605108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.619035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1169/2337] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:44.619222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d829-7399-4c1b-baea-f903d2904132 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.620603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.623914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.624568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.624938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.630340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.631099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db681b0-24df-4f55-a37d-df69268ff51a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.636454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68ce44-d446-44f3-b1fd-83d55b64ebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.637063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ce44-d446-44f3-b1fd-83d55b64ebe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.637416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ce44-d446-44f3-b1fd-83d55b64ebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.637886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68ce44-d446-44f3-b1fd-83d55b64ebe5 admin admin] PATH_INFO: `/v3/projects/bacaef28f5974df1a8a9d43703a1da45/users/7752ee54f41548fca3f518722520c16a/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.640287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68ce44-d446-44f3-b1fd-83d55b64ebe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacaef28f5974df1a8a9d43703a1da45, user_id=7752ee54f41548fca3f518722520c16a, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.642833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68ce44-d446-44f3-b1fd-83d55b64ebe5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.654795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1170/2338] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:44 2022] PUT /identity/v3/projects/bacaef28f5974df1a8a9d43703a1da45/users/7752ee54f41548fca3f518722520c16a/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:40:44.667554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.667843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.668143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.695984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.697893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.701120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] MFA Rules not processed for user `7752ee54f41548fca3f518722520c16a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:44.702503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:44.707893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1169/2339] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:40:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:40:44.800990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1171/2340] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:44.812306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:44.814312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:44.882245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b3ef-438c-4546-ac5e-d76d1335c541 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:44.945115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54a8bd-7ae3-408d-8214-0f9a882171ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:44.945784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54a8bd-7ae3-408d-8214-0f9a882171ab service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:44.946071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54a8bd-7ae3-408d-8214-0f9a882171ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:44.946346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54a8bd-7ae3-408d-8214-0f9a882171ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:44.961826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54a8bd-7ae3-408d-8214-0f9a882171ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:44.966465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54a8bd-7ae3-408d-8214-0f9a882171ab service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:44.976799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1170/2341] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:45.732306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:45.835166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8d81-1079-4583-ab02-d8b88300df12 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:45.844078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:45.845138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:45.845433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:45.845763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] PATH_INFO: `/v3/users/b6f4ea98013946eb9fc5156b9acb1a1e` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:45.847139 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f4ea98013946eb9fc5156b9acb1a1e)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:45.849250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:46.029306 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f4ea98013946eb9fc5156b9acb1a1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:46.030155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f4ea98013946eb9fc5156b9acb1a1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:46.033446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:46.105548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f4ea98013946eb9fc5156b9acb1a1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:46.114814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f4ea98013946eb9fc5156b9acb1a1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:46.116128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f4ea98013946eb9fc5156b9acb1a1e'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:46.143851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1172/2342] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:45 2022] DELETE /identity/v3/users/b6f4ea98013946eb9fc5156b9acb1a1e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:46.145755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:46.146224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:46.146330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:46.155029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:46.166402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:46.167627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:46.240157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1171/2343] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:46.250502 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:46.253091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:46.323846 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628827ad-2d2e-4403-b12d-0fa07feae412 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:46.331160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:46.331965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:46.332351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:46.332781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:46.344406 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:46.346064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:46.357817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1173/2344] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:46.926103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:46.927769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:46.950726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1f389-17b6-4d55-a633-68a22c111b8f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:46.958810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:46.959790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:46.960151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:46.960525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] PATH_INFO: `/v3/projects/823dc554348a4fc4b613c5effe4fcf08` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:46.961994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823dc554348a4fc4b613c5effe4fcf08)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:46.964028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:47.097614 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823dc554348a4fc4b613c5effe4fcf08', 'request_id': 'req-de66749f-96c0-4191-a7c3-3a598407c2b0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.103622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823dc554348a4fc4b613c5effe4fcf08', 'request_id': 'req-de66749f-96c0-4191-a7c3-3a598407c2b0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.111350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823dc554348a4fc4b613c5effe4fcf08', 'request_id': 'req-de66749f-96c0-4191-a7c3-3a598407c2b0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.189056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] The token cache is being invalidate because project 823dc554348a4fc4b613c5effe4fcf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:47.190923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.193116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.194768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1172/2345] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:46 2022] DELETE /identity/v3/projects/823dc554348a4fc4b613c5effe4fcf08 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:47.199069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:47.213278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef53da7-aed7-4d8c-a4db-0dcadab34c02 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:47.298255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:47.299227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:47.299583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:47.299940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] PATH_INFO: `/v3/users/7752ee54f41548fca3f518722520c16a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:47.301340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7752ee54f41548fca3f518722520c16a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:47.303329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:47.614362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7752ee54f41548fca3f518722520c16a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.615045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7752ee54f41548fca3f518722520c16a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.725353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7752ee54f41548fca3f518722520c16a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.735983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7752ee54f41548fca3f518722520c16a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.735983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-86442005-8712-48f6-a19b-15df337220ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7752ee54f41548fca3f518722520c16a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:47.743851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:47.757198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1174/2346] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:47 2022] DELETE /identity/v3/users/7752ee54f41548fca3f518722520c16a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:48.438934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:48.440548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:48.458607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66749f-96c0-4191-a7c3-3a598407c2b0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:48.530600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:48.531574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:48.532184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:48.532744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] PATH_INFO: `/v3/projects/bacaef28f5974df1a8a9d43703a1da45` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:48.534148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacaef28f5974df1a8a9d43703a1da45)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:48.536284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:48.695947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:48.723304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacaef28f5974df1a8a9d43703a1da45', 'request_id': 'req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:48.729512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacaef28f5974df1a8a9d43703a1da45', 'request_id': 'req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:48.737142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacaef28f5974df1a8a9d43703a1da45', 'request_id': 'req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:48.868538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] The token cache is being invalidate because project bacaef28f5974df1a8a9d43703a1da45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:48.869039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:48.869840 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-779ec9d8-5a39-4eeb-98ee-f45fa6395ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:48.871907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1173/2347] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:48 2022] DELETE /identity/v3/projects/bacaef28f5974df1a8a9d43703a1da45 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:48.876589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:48.877089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:48.882532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:48.901563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:48.902721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:48.976908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1175/2348] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:48.985040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:48.985342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:48.985629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.010455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:49.011675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:49.024189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1174/2349] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:49.025684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.037505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98be4d-cf13-4ee1-af81-90597f8021af None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.043312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.044074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.044356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.044671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.045422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:40:49.045736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.047387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.063452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1176/2350] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:40:49.064680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.077239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccb82c-5d9a-4fe2-8ad6-af22e7bc31e5 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.082543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.083305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.083666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.084016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.084886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.086912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.197787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1175/2351] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:49 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:40:49.198839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.211932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e0760-3bb5-4310-9387-922b24e180ed admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.280499 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.281280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.281569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.281843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.282593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.284494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.402015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1177/2352] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:49 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:40:49.405396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.422756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dd82e-fa83-4a48-ba4f-7704519bb2fb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.429465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.430452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.430834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.431230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.432909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.436213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.459449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1176/2353] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:49.460075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.466524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a709ee-3ce6-4646-91f3-a3b0a718668d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.474435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e495982-49d5-4fef-a345-535bc5d1a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.475238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e495982-49d5-4fef-a345-535bc5d1a76c admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.475595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e495982-49d5-4fef-a345-535bc5d1a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.475988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e495982-49d5-4fef-a345-535bc5d1a76c admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.476900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e495982-49d5-4fef-a345-535bc5d1a76c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.486875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e495982-49d5-4fef-a345-535bc5d1a76c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.501515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1178/2354] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:40:49.505831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.518500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962f506-163e-4592-900d-8fb50bdf1528 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.525042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.526062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.526342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.526635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] PATH_INFO: `/v3/projects/986b877abb274d89af89e8f79b27f322/users/32d7d483e9934c6b871f2466d1a1d92a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.550958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986b877abb274d89af89e8f79b27f322, user_id=32d7d483e9934c6b871f2466d1a1d92a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.554267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.664699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1177/2355] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:49 2022] PUT /identity/v3/projects/986b877abb274d89af89e8f79b27f322/users/32d7d483e9934c6b871f2466d1a1d92a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:40:49.673724 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.674188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.674537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.715761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] MFA Rules not processed for user `32d7d483e9934c6b871f2466d1a1d92a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:49.717016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:49.774012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:49.795589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1179/2356] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:49.807379 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:49.809990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:49.894068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2c719-bc71-42c1-b8e5-265320886e20 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:49.898294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:49.899082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:49.899451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:49.899941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:49.916428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:49.917955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:49.928869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1178/2357] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:56.282257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:56.283751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:56.358498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc8d8f-252c-431e-8a91-5901625aa91b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:56.364023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:56.364699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:56.364985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:56.365264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:56.367046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:56.443260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:56.444883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0371aa0d-cd7f-46e5-8677-795fa0c4b83e service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:56.454215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1180/2358] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:57.469676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:57.535356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:57.543587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd767d-0678-4ec8-a885-276e264f6247 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:57.545641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:57.546721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:57.547012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:57.547290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] PATH_INFO: `/v3/users/32d7d483e9934c6b871f2466d1a1d92a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:57.548553 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d7d483e9934c6b871f2466d1a1d92a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:57.550601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:57.750315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d7d483e9934c6b871f2466d1a1d92a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:57.763584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d7d483e9934c6b871f2466d1a1d92a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:57.764303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d7d483e9934c6b871f2466d1a1d92a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:57.771363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d7d483e9934c6b871f2466d1a1d92a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:57.861521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d7d483e9934c6b871f2466d1a1d92a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:57.868584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1179/2359] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:40:57 2022] DELETE /identity/v3/users/32d7d483e9934c6b871f2466d1a1d92a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:57.873892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:57.874400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:57.874495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:57.893166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:57.893433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:57.953162 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1181/2360] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:57.963330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:57.964770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:58.029200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f6b8a-5476-43e2-885a-1c131ce5fb94 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:58.034418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489732d-7f48-4dee-ae37-da189bc791a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:58.035369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489732d-7f48-4dee-ae37-da189bc791a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:58.035876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489732d-7f48-4dee-ae37-da189bc791a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:58.036298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489732d-7f48-4dee-ae37-da189bc791a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:58.049010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489732d-7f48-4dee-ae37-da189bc791a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:58.050942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489732d-7f48-4dee-ae37-da189bc791a1 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:58.076826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1180/2361] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:40:58.579836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:58.579836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:58.590989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c318401-8061-40a0-b282-de52fa69abe6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:58.595981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:58.597068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:58.597456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:58.597797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] PATH_INFO: `/v3/projects/986b877abb274d89af89e8f79b27f322` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:58.599110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] RBAC: Authorizing `identity:delete_project(project_id=986b877abb274d89af89e8f79b27f322)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:58.601100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:58.620554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:58.747220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986b877abb274d89af89e8f79b27f322', 'request_id': 'req-e23f5143-f201-4754-8d39-fca8a693312a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:58.753910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986b877abb274d89af89e8f79b27f322', 'request_id': 'req-e23f5143-f201-4754-8d39-fca8a693312a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:58.810684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986b877abb274d89af89e8f79b27f322', 'request_id': 'req-e23f5143-f201-4754-8d39-fca8a693312a'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:58.822509 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] The token cache is being invalidate because project 986b877abb274d89af89e8f79b27f322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:40:58.822802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:58.823740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e23f5143-f201-4754-8d39-fca8a693312a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:40:58.826072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1182/2362] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:40:58 2022] DELETE /identity/v3/projects/986b877abb274d89af89e8f79b27f322 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:58.832260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:58.832260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:58.832260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:58.852219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:58.853492 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:58.924922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1181/2363] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:58.932892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:58.934369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:58.934829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:58.954648 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:58.955881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:58.963940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1183/2364] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:58.968185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:58.977812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fff027-0cf7-4a0c-ba63-6612d3247b5a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:58.982532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:58.983187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:58.983472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:58.983750 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:58.984487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:40:58.984824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:58.986431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.001596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1182/2365] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:40:59.002766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.011888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f1f58-a286-4a63-a3d8-b7e8f2c1b854 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.017005 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.017651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.017935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.018213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.018903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.020875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.075866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.077595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:59.087674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:59.114163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1184/2366] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:40:59 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:59.118225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.163013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1040dae-e1cb-40d6-9806-6cc9bb98a16c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.202262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f86412-7465-46e8-b609-00c6e0411bfc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.210512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.211431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.211715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.213486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.214228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.216579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.246182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.247734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.247734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.247938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.259479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:59.313964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1185/2367] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:40:59 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:40:59.320513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.321461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.323453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.331197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dd0e5-0955-4b58-b095-6f7b3be5828e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.335609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1183/2368] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:40:59.345454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.346131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.346419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.346696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.347426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.349073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.361019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1186/2369] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:59.365113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.376437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46150bfe-1545-4221-95a8-4f31de3e3bbc service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.381321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efa931-fa4a-4ee2-91bf-b9fc1a754fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.382013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efa931-fa4a-4ee2-91bf-b9fc1a754fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.382259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efa931-fa4a-4ee2-91bf-b9fc1a754fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.382696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efa931-fa4a-4ee2-91bf-b9fc1a754fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.383466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efa931-fa4a-4ee2-91bf-b9fc1a754fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.385091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efa931-fa4a-4ee2-91bf-b9fc1a754fbf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.399166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1184/2370] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:40:59.401405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.417241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9658-1f48-45fc-824a-b24e78488789 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.422945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.423921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.424343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.424744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] PATH_INFO: `/v3/projects/25ff2036a0824bf280108010649cbef2/users/be6a96d597974d4a93333a9dfba4f940/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.444105 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25ff2036a0824bf280108010649cbef2, user_id=be6a96d597974d4a93333a9dfba4f940, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.446946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.524950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1187/2371] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:40:59 2022] PUT /identity/v3/projects/25ff2036a0824bf280108010649cbef2/users/be6a96d597974d4a93333a9dfba4f940/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:40:59.535471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee195-0e69-4261-9161-c74e18a12128 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.535763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee195-0e69-4261-9161-c74e18a12128 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.536066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0ee195-0e69-4261-9161-c74e18a12128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.570174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-da0ee195-0e69-4261-9161-c74e18a12128 None None] MFA Rules not processed for user `be6a96d597974d4a93333a9dfba4f940`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:40:59.571379 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-da0ee195-0e69-4261-9161-c74e18a12128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:59.597535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:59.644683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1185/2372] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:40:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:40:59.656758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:40:59.658560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:40:59.694666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:40:59.718342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3abf02-7b53-4c19-96e4-4dc766780f58 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:40:59.722124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f40db-4940-4ad0-9a7e-3014e2aa851f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:40:59.722775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f40db-4940-4ad0-9a7e-3014e2aa851f service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:40:59.723065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f40db-4940-4ad0-9a7e-3014e2aa851f service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:40:59.723347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f40db-4940-4ad0-9a7e-3014e2aa851f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:40:59.732975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f40db-4940-4ad0-9a7e-3014e2aa851f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:40:59.734412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f40db-4940-4ad0-9a7e-3014e2aa851f service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:40:59.743618 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1188/2373] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:40:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:02.738810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21647a-fcc4-44c3-a566-d658a9aaf6a0 None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:02.739394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21647a-fcc4-44c3-a566-d658a9aaf6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:02.739394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21647a-fcc4-44c3-a566-d658a9aaf6a0 None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:02.740773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1186/2374] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:41:02.746708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bf27a-3488-49d9-a794-ae8dd192eaa7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:02.747172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bf27a-3488-49d9-a794-ae8dd192eaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:02.747273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538bf27a-3488-49d9-a794-ae8dd192eaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:02.771090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-538bf27a-3488-49d9-a794-ae8dd192eaa7 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:02.772301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-538bf27a-3488-49d9-a794-ae8dd192eaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:02.841773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1189/2375] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:02.853314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21647a-fcc4-44c3-a566-d658a9aaf6a0 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:02.855108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5e21647a-fcc4-44c3-a566-d658a9aaf6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:02.948786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21647a-fcc4-44c3-a566-d658a9aaf6a0 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:02.953077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae5980-c724-473a-99ac-5bc318e3468f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:02.953859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5980-c724-473a-99ac-5bc318e3468f service glance] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:02.954221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5980-c724-473a-99ac-5bc318e3468f service glance] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:02.954571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae5980-c724-473a-99ac-5bc318e3468f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:02.966020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae5980-c724-473a-99ac-5bc318e3468f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:02.967490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae5980-c724-473a-99ac-5bc318e3468f service glance] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:02.978437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1187/2376] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:03.189490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b450db8-7808-4195-9c81-966d0c6b9cfd None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.189781 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b450db8-7808-4195-9c81-966d0c6b9cfd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.190064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b450db8-7808-4195-9c81-966d0c6b9cfd None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.191584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1190/2377] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:41:03.196557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b28631-80e7-4180-905f-9bfa292d17da None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.196873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b28631-80e7-4180-905f-9bfa292d17da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.197153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b28631-80e7-4180-905f-9bfa292d17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.218045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-87b28631-80e7-4180-905f-9bfa292d17da None None] MFA Rules not processed for user `046675b504304fb6991ff823ef931802`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:03.219262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-87b28631-80e7-4180-905f-9bfa292d17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:03.269527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1188/2378] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:03.281685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b450db8-7808-4195-9c81-966d0c6b9cfd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:03.283517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b450db8-7808-4195-9c81-966d0c6b9cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:03.296625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b450db8-7808-4195-9c81-966d0c6b9cfd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:03.300293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5302a-9ee8-46f3-ad0c-bfe172f13b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:03.300995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5302a-9ee8-46f3-ad0c-bfe172f13b72 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.301281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5302a-9ee8-46f3-ad0c-bfe172f13b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.306521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5302a-9ee8-46f3-ad0c-bfe172f13b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.308867 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5302a-9ee8-46f3-ad0c-bfe172f13b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:03.310346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5302a-9ee8-46f3-ad0c-bfe172f13b72 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:03.318119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1191/2379] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:03.435596 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c341f6-92ca-4d3d-a67e-8d843b86ee1e None None] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.435885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c341f6-92ca-4d3d-a67e-8d843b86ee1e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.436163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c341f6-92ca-4d3d-a67e-8d843b86ee1e None None] PATH_INFO: `/` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.437603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1189/2380] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 20:41:03.442800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.443030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.443332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.461978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] MFA Rules not processed for user `7be4c89082ac47d786cf7e1821ed01b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:03.463175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:03.472251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1192/2381] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:41:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:03.482612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c341f6-92ca-4d3d-a67e-8d843b86ee1e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:03.484403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-52c341f6-92ca-4d3d-a67e-8d843b86ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:03.499283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c341f6-92ca-4d3d-a67e-8d843b86ee1e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:03.503943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:03.504740 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.505055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.505328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.517927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:03.519399 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:03.530113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1190/2382] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:03.592215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:03.593665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:03.662250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba196e-029b-444d-ba48-1e5e68a47665 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:03.667468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:03.668120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:03.668408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:03.668720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:03.670538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:03.681828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:03.683898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ec257-c320-4434-91ec-29a48d3a4ef6 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:03.693917 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1193/2383] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:03.978901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:04.035641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:04.056920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963eedf-1dfa-4c80-8e66-d56e3f51de31 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:04.062260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:04.063130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:04.063416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:04.063736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] PATH_INFO: `/v3/users/be6a96d597974d4a93333a9dfba4f940` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:04.064922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6a96d597974d4a93333a9dfba4f940)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:04.069448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:04.271219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6a96d597974d4a93333a9dfba4f940'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:04.289586 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6a96d597974d4a93333a9dfba4f940'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:04.290475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6a96d597974d4a93333a9dfba4f940'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:04.298470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6a96d597974d4a93333a9dfba4f940'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:04.398518 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6a96d597974d4a93333a9dfba4f940'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:04.406138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1191/2384] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:03 2022] DELETE /identity/v3/users/be6a96d597974d4a93333a9dfba4f940 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:04.410921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:04.411432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:04.411536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:04.429308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:04.430572 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:04.461168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:04.490561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1194/2385] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:04.500578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:04.502114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:04.566450 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf8d75-58d0-45c2-8dc4-b081855c51f5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:04.570156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ba970-73df-4a24-8485-317146b532c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:04.570801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba970-73df-4a24-8485-317146b532c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:04.571080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba970-73df-4a24-8485-317146b532c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:04.571349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ba970-73df-4a24-8485-317146b532c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:04.581940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba970-73df-4a24-8485-317146b532c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:04.583423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ba970-73df-4a24-8485-317146b532c3 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:04.593804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1192/2386] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:05.249374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:05.250891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:05.272901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e850609-3ae6-4b89-9c8f-4b11cc6b6d5d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:05.277920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:05.278809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.279093 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.279373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] PATH_INFO: `/v3/projects/25ff2036a0824bf280108010649cbef2` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:05.280590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25ff2036a0824bf280108010649cbef2)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:05.283977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:05.406771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25ff2036a0824bf280108010649cbef2', 'request_id': 'req-1556b372-b766-4b4e-a3d2-5a09464774d9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:05.413717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25ff2036a0824bf280108010649cbef2', 'request_id': 'req-1556b372-b766-4b4e-a3d2-5a09464774d9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:05.495516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25ff2036a0824bf280108010649cbef2', 'request_id': 'req-1556b372-b766-4b4e-a3d2-5a09464774d9'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:05.507625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] The token cache is being invalidate because project 25ff2036a0824bf280108010649cbef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:05.507913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:05.508541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1556b372-b766-4b4e-a3d2-5a09464774d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:05.510224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1195/2387] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:05 2022] DELETE /identity/v3/projects/25ff2036a0824bf280108010649cbef2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:05.515106 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.516825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.516825 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:05.534865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:05.536085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:05.624712 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1193/2388] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:05.632390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.632731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.633038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:05.651824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:05.653617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:05.662949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1196/2389] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:05.667162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:05.672762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:05.677997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8c8db-9fd2-4373-b845-1bd9bb9d86ad None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:05.682541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:05.683256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.683595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.683870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:05.684807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:05.688309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:05.688309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:05.698838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1194/2390] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:05.703321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:05.713241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eea8a-5887-41bb-9ec8-4008b13b2c60 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:05.719698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06cbcd-30ad-4052-a746-7ae017e2bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:05.720359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06cbcd-30ad-4052-a746-7ae017e2bd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.720729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06cbcd-30ad-4052-a746-7ae017e2bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.721017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06cbcd-30ad-4052-a746-7ae017e2bd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:05.721928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06cbcd-30ad-4052-a746-7ae017e2bd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:05.723881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06cbcd-30ad-4052-a746-7ae017e2bd70 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:05.846755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1197/2391] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:05 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:05.850762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:05.861527 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4047a59-e2b9-47e7-a53a-a5e678113331 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:05.915592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:05.916253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.916537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.916848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:05.917543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:05.920041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:05.986351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:05.986649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:05.986940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.004497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:06.005722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:06.033700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1195/2392] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:05 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:06.037782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:06.047192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6d2a1-af87-45f5-a265-ee0d13287b80 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:06.051865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:06.054499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.054499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.054499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.054499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:06.055374 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:06.062348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1198/2393] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:06.065790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1196/2394] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:06.069621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:06.078606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:06.078606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:06.081898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6d856-913f-47e9-8f3c-9544a779d3c5 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:06.086940 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:06.087657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.087939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.088215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.089055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:06.092110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:06.103608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1199/2395] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:06.107551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:06.117291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b43801f-535c-4c11-bbbc-2d4cbed55d37 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:06.122041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:06.123505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.123505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.123505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] PATH_INFO: `/v3/projects/4154b166ffde49c984d4898a623c5e0a/users/b33d4f6ecdc546efb061a8ada013d85f/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.138629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4154b166ffde49c984d4898a623c5e0a, user_id=b33d4f6ecdc546efb061a8ada013d85f, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:06.141399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:06.149164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8780698-2d06-477f-a530-cb00d6cdd49a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:06.154890 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f942f-7c97-402c-923b-d7d810ec0e8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:06.157972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f942f-7c97-402c-923b-d7d810ec0e8d service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.157972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f942f-7c97-402c-923b-d7d810ec0e8d service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.157972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f942f-7c97-402c-923b-d7d810ec0e8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.164510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f942f-7c97-402c-923b-d7d810ec0e8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:06.166185 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f942f-7c97-402c-923b-d7d810ec0e8d service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:06.174316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1197/2396] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:41:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 20:41:06.201503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:06.206607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1200/2397] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:06 2022] PUT /identity/v3/projects/4154b166ffde49c984d4898a623c5e0a/users/b33d4f6ecdc546efb061a8ada013d85f/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:06.211730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.212120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.212454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.231171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:06.232493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:06.291923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1198/2398] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:06.301577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:06.303292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:06.369616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d7af5-29b3-4e0e-99d7-eeeb094633a5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:06.375204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282461e0-a7b5-4e02-8d99-bafc1dd53000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:06.376077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282461e0-a7b5-4e02-8d99-bafc1dd53000 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.376644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282461e0-a7b5-4e02-8d99-bafc1dd53000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.376918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282461e0-a7b5-4e02-8d99-bafc1dd53000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.384964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:06.390511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282461e0-a7b5-4e02-8d99-bafc1dd53000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:06.392107 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282461e0-a7b5-4e02-8d99-bafc1dd53000 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:06.416547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1201/2399] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:06.729003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:06.731271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:06.743599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610ba6f-371b-4366-a492-b46ee724697c None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:06.749525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:06.750287 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:06.750807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:06.751167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:06.753116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:06.769705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:06.771417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:06.804409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1199/2400] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:07.925029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36f15-a316-4e3f-b86b-99ce9efe5dd9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:07.925615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36f15-a316-4e3f-b86b-99ce9efe5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:07.925615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d36f15-a316-4e3f-b86b-99ce9efe5dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:07.956357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-27d36f15-a316-4e3f-b86b-99ce9efe5dd9 None None] MFA Rules not processed for user `b33d4f6ecdc546efb061a8ada013d85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:07.957751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-27d36f15-a316-4e3f-b86b-99ce9efe5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:08.036995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1202/2401] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:08.050406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:08.053008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:08.142584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f000b33-292c-41d1-92c7-57531a5426a2 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:08.147166 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:08.148603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:08.149040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:08.149410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:08.161114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:08.163520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:08.178665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1200/2402] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:10.270706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65484-bf81-4d79-abcb-7866b9207290 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:10.271255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65484-bf81-4d79-abcb-7866b9207290 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:10.271476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65484-bf81-4d79-abcb-7866b9207290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:10.295411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7bd65484-bf81-4d79-abcb-7866b9207290 None None] MFA Rules not processed for user `b33d4f6ecdc546efb061a8ada013d85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:10.296672 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7bd65484-bf81-4d79-abcb-7866b9207290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:10.306029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1203/2403] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:10.629281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:10.640212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961116af-b0e5-468b-a701-1c4af3376344 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:10.648117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:10.656667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:10.656667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:10.656667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:10.656667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:10.668644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:10.670146 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41cfd3-037e-4c7e-9dee-4af91f9238a0 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:10.681705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1201/2404] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:12.082730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6eb67-1f75-4b76-8c0f-2f25adde2827 None None] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:12.083377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6eb67-1f75-4b76-8c0f-2f25adde2827 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:12.083488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6eb67-1f75-4b76-8c0f-2f25adde2827 None None] PATH_INFO: `/` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:12.085150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1204/2405] 10.222.0.65 () {54 vars in 921 bytes} [Thu Jun 16 20:41:12 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 20:41:12.114812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:12.115392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:12.115573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:12.180699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] MFA Rules not processed for user `31897a7b7dda4dc1be1ee7a0d32bdd81`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:12.182659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:12.272020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1202/2406] 10.222.0.65 () {58 vars in 1018 bytes} [Thu Jun 16 20:41:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:12.284901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6eb67-1f75-4b76-8c0f-2f25adde2827 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:12.287236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3cd6eb67-1f75-4b76-8c0f-2f25adde2827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:12.313776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6eb67-1f75-4b76-8c0f-2f25adde2827 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:12.324934 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:12.326461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:12.327254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:12.328322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:12.343933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:12.346437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:12.376741 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1205/2407] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:12.458519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:12.460946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:12.498283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84671b94-256c-4df4-a7f9-ba1b2f6483ad None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:12.509761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:12.510723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:12.511823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:12.512259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] PATH_INFO: `/v3/users/7926fb5f95ef4b6e894b7dac7f91625a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:12.518005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7926fb5f95ef4b6e894b7dac7f91625a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:12.520238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:12.782521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7926fb5f95ef4b6e894b7dac7f91625a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:12.788711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:12.797832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7926fb5f95ef4b6e894b7dac7f91625a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:12.798564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7926fb5f95ef4b6e894b7dac7f91625a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:12.813229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7926fb5f95ef4b6e894b7dac7f91625a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:12.921666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-3260d442-5d7c-45c2-9df3-24b4c9d6871e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7926fb5f95ef4b6e894b7dac7f91625a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:12.933490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1203/2408] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:12 2022] DELETE /identity/v3/users/7926fb5f95ef4b6e894b7dac7f91625a => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:13.249003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:13.263636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb385a5-e328-4c58-9bc5-41a18c889133 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:13.340701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:13.341537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:13.341821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:13.342099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] PATH_INFO: `/v3/projects/628a4c09944b47a5a43e4c27caae9619` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:13.343304 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] RBAC: Authorizing `identity:delete_project(project_id=628a4c09944b47a5a43e4c27caae9619)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:13.345276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:13.363914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:13.463776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628a4c09944b47a5a43e4c27caae9619', 'request_id': 'req-1a65b344-ea46-43e6-9213-4cbbbd41683d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:13.470621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628a4c09944b47a5a43e4c27caae9619', 'request_id': 'req-1a65b344-ea46-43e6-9213-4cbbbd41683d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:13.556786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628a4c09944b47a5a43e4c27caae9619', 'request_id': 'req-1a65b344-ea46-43e6-9213-4cbbbd41683d'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:13.568745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] The token cache is being invalidate because project 628a4c09944b47a5a43e4c27caae9619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:13.569143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:13.569900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1a65b344-ea46-43e6-9213-4cbbbd41683d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:13.571649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1206/2409] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:13 2022] DELETE /identity/v3/projects/628a4c09944b47a5a43e4c27caae9619 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:13.579449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5499c-6047-4385-a421-e02eca860930 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:13.584475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5499c-6047-4385-a421-e02eca860930 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:13.584475 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5499c-6047-4385-a421-e02eca860930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:13.601597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-79a5499c-6047-4385-a421-e02eca860930 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:13.603405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-79a5499c-6047-4385-a421-e02eca860930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:13.687429 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1204/2410] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:13.695602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:13.696270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:13.696974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:13.718236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:13.719899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:13.729261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1207/2411] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:13.733210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5499c-6047-4385-a421-e02eca860930 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:13.751343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5499c-6047-4385-a421-e02eca860930 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:13.758352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:13.759380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:13.759785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:13.760147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:13.761627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:13.768303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:13.768720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:13.788406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1205/2412] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:13.794037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:13.805834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c1580-e74d-4ed9-a6e3-5730b3dc8923 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:13.811186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:13.812030 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:13.812467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:13.812907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:13.814368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:13.817932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:13.906728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1208/2413] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:13 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:13.913645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:13.924505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606a4b1f-79a2-447f-b07c-ec7380ce84f6 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:14.001324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:14.002072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:14.002352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:14.002633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:14.003341 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:14.005645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:14.381544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1206/2414] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:13 2022] POST /identity/v3/users => generated 292 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:14.385698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:14.395986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3493a-9eae-4d98-8fcc-1357eb34c17f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:14.400523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:14.401223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:14.401654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:14.401935 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:14.402667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:14.404259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:14.414566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1209/2415] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:14.418954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:14.428667 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30924d35-b1a9-4116-ac25-a189fa6a73c4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:14.433778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa920f-a75f-4183-923f-fc8077416c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:14.440952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa920f-a75f-4183-923f-fc8077416c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:14.440952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa920f-a75f-4183-923f-fc8077416c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:14.440952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa920f-a75f-4183-923f-fc8077416c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:14.440952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa920f-a75f-4183-923f-fc8077416c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:14.440952 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa920f-a75f-4183-923f-fc8077416c25 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:14.447018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1207/2416] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:14.451406 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:14.462523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be4a87-d431-47f6-8984-9568eb9e91ad admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:14.467380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:14.470901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:14.470901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:14.470901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] PATH_INFO: `/v3/projects/1ec0748ae4cb47f4b9c019a8212d5f76/users/1f636742339c45b28c78e7f3a71a0bd8/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:14.484192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec0748ae4cb47f4b9c019a8212d5f76, user_id=1f636742339c45b28c78e7f3a71a0bd8, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:14.486978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:14.547249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1210/2417] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:14 2022] PUT /identity/v3/projects/1ec0748ae4cb47f4b9c019a8212d5f76/users/1f636742339c45b28c78e7f3a71a0bd8/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:14.557557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0101277-9124-4001-a356-f41f916034f4 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:14.558441 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0101277-9124-4001-a356-f41f916034f4 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:14.558724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0101277-9124-4001-a356-f41f916034f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:14.585051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c0101277-9124-4001-a356-f41f916034f4 None None] MFA Rules not processed for user `1f636742339c45b28c78e7f3a71a0bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:14.586282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0101277-9124-4001-a356-f41f916034f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:14.611273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:14.651356 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1208/2418] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:14.662354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:14.664058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:14.739876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443ea84-900a-4567-a8e4-797be99c9f5a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:14.745801 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:14.746459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:14.746741 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:14.747013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:14.754722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:14.756270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:14.764991 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1211/2419] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:15.424654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0101277-9124-4001-a356-f41f916034f4 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:15.426247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0101277-9124-4001-a356-f41f916034f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:15.453134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0101277-9124-4001-a356-f41f916034f4 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:15.459523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:15.460229 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:15.460600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:15.466020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:15.466020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:15.521872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:15.523525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:15.533727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1209/2420] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:17.293620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:17.295100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:17.325336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:17.354013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceeea8-ecad-4ebd-9fde-094abcafb629 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:17.358150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:17.358791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:17.359132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:17.359529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:17.361302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:17.372065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:17.373557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce807f-b5ab-4ca1-af6c-b942cb67f079 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:17.381772 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1212/2421] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:21.669640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:21.732949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bcc4e-ab83-4804-b86f-c7ee62f8394e service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:21.737798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:21.738666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:21.740573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:21.740573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] PATH_INFO: `/v3/users/1f636742339c45b28c78e7f3a71a0bd8` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:21.740573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f636742339c45b28c78e7f3a71a0bd8)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:21.742336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:21.976320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f636742339c45b28c78e7f3a71a0bd8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:21.988507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f636742339c45b28c78e7f3a71a0bd8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:21.989214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f636742339c45b28c78e7f3a71a0bd8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:21.990453 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:21.997073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f636742339c45b28c78e7f3a71a0bd8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:22.083476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f636742339c45b28c78e7f3a71a0bd8'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:22.090268 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1210/2422] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:21 2022] DELETE /identity/v3/users/1f636742339c45b28c78e7f3a71a0bd8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:22.094695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30cbbc-552c-4298-8c21-1dfe81fb9007 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:22.095165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30cbbc-552c-4298-8c21-1dfe81fb9007 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:22.095280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30cbbc-552c-4298-8c21-1dfe81fb9007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:22.112926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ea30cbbc-552c-4298-8c21-1dfe81fb9007 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:22.118574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ea30cbbc-552c-4298-8c21-1dfe81fb9007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:22.172082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1213/2423] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:22.182021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:22.183443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:22.244439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed600486-ecb2-4a5b-9363-cee511c05e76 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:22.248220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:22.248899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:22.249183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:22.249458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:22.259013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:22.260446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:22.270244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1211/2424] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:22.328351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:22.328662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:22.328948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:22.348818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:22.350085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:22.406324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1214/2425] 10.222.0.65 () {58 vars in 967 bytes} [Thu Jun 16 20:41:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:22.419484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:22.420976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:22.499068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c06db-1bde-4a04-9021-cc360c2bb3a6 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:22.503751 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc480-531e-45e8-b363-6eabbaf2fb0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:22.504782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc480-531e-45e8-b363-6eabbaf2fb0a service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:22.504916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc480-531e-45e8-b363-6eabbaf2fb0a service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:22.505256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc480-531e-45e8-b363-6eabbaf2fb0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:22.515588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cc480-531e-45e8-b363-6eabbaf2fb0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:22.517413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cc480-531e-45e8-b363-6eabbaf2fb0a service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:22.527038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1212/2426] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:41:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:41:22.820172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:22.821617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:22.837673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18482aad-555d-4da1-a918-14beeefa9c2d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:22.844588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:22.845566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:22.846076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:22.846452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] PATH_INFO: `/v3/projects/1ec0748ae4cb47f4b9c019a8212d5f76` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:22.847987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec0748ae4cb47f4b9c019a8212d5f76)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:22.850073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:22.987838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec0748ae4cb47f4b9c019a8212d5f76', 'request_id': 'req-a791dc76-0221-4c87-b6bc-0514385ee63f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:22.993948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec0748ae4cb47f4b9c019a8212d5f76', 'request_id': 'req-a791dc76-0221-4c87-b6bc-0514385ee63f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:23.083403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec0748ae4cb47f4b9c019a8212d5f76', 'request_id': 'req-a791dc76-0221-4c87-b6bc-0514385ee63f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:23.088530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:23.095163 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] The token cache is being invalidate because project 1ec0748ae4cb47f4b9c019a8212d5f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:23.095742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:23.096085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a791dc76-0221-4c87-b6bc-0514385ee63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:23.097684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1215/2427] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:22 2022] DELETE /identity/v3/projects/1ec0748ae4cb47f4b9c019a8212d5f76 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:23.102703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.103186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.103396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.121815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:23.123019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:23.185499 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1213/2428] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:23.194263 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.194558 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.195026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.213822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:23.215034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:23.223092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1216/2429] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:23.227239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.237354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d39be4-8f76-4f50-80d6-cc4b40a5221f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.241858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.242481 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.242758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.243066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.243784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:23.244115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.248027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.259346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1214/2430] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:23.263786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.272823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00708-97ca-40d1-bc77-ee41c85ce47b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.277549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.278194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.278479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.278756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.279447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.281384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.367609 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1217/2431] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:23 2022] POST /identity/v3/projects => generated 405 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:23.368671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.374612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:23.379913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d12fd6-4924-4eee-b745-661f1f245d9f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.436194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.437056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.437345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.437625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.438334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.440419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.527315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1215/2432] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:23 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:23.531427 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.542931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56517-2197-4b65-83f1-9819ee3c1d87 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.548154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.548906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.549190 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.549462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.550193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.552278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.563817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1218/2433] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:23.567978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.578435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8035dc-480f-408a-8eec-1c40a8dc8f4e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.583222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be487909-34fb-46dc-b7a5-1918a63f2f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.583880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be487909-34fb-46dc-b7a5-1918a63f2f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.584186 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be487909-34fb-46dc-b7a5-1918a63f2f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.584460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be487909-34fb-46dc-b7a5-1918a63f2f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.585237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be487909-34fb-46dc-b7a5-1918a63f2f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.586863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be487909-34fb-46dc-b7a5-1918a63f2f2a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.597597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1216/2434] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:23.601712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.612579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e34cb-4109-4822-83e3-ffdf17f7bd16 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.619154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.620690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.621192 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.621662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] PATH_INFO: `/v3/projects/a4fa87d0b79f443caaf29be94df6fc3f/users/0a955b578c3a4aa2ac319f80ea8af3f6/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.638783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4fa87d0b79f443caaf29be94df6fc3f, user_id=0a955b578c3a4aa2ac319f80ea8af3f6, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.642002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.721946 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1219/2435] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:23 2022] PUT /identity/v3/projects/a4fa87d0b79f443caaf29be94df6fc3f/users/0a955b578c3a4aa2ac319f80ea8af3f6/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:23.727190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39d2d9-05d0-46a2-86d8-f4417aa05b46 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.728315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39d2d9-05d0-46a2-86d8-f4417aa05b46 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.728730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39d2d9-05d0-46a2-86d8-f4417aa05b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.748513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4d39d2d9-05d0-46a2-86d8-f4417aa05b46 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:23.749361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4d39d2d9-05d0-46a2-86d8-f4417aa05b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:23.847741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1217/2436] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:23.857892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:23.859642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:23.923317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48d78-778d-4d20-8d5e-b6b549866cfd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:23.928585 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:23.929260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:23.929542 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:23.929816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:23.941382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:23.942859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:23.955697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1220/2437] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:25.314190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:25.314687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:25.314785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:25.342297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] MFA Rules not processed for user `0a955b578c3a4aa2ac319f80ea8af3f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:25.343497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:25.410525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1218/2438] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:25.414986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:25.425095 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca54842-49be-4eb7-90b1-ccf207ef2fac service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:25.429668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:25.430305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:25.430589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:25.430865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:25.431554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:25.433979 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:25.510148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1221/2439] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:25 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:25.514050 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:25.524719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e49a2-9450-49e0-9ce5-3a553ecc2805 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:25.532652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:25.582251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:25.582935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:25.583222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:25.583500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:25.584211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:25.586207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:25.754151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1219/2440] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:25 2022] POST /identity/v3/users => generated 309 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:25.758183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:25.768534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3a12f-b889-4bbd-9436-27d05a63a9ad admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:25.773219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:25.773883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:25.774170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:25.774451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:25.775183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:25.776820 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:25.787779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1222/2441] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:25.792477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:25.802647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e37a03-f4cd-4ea8-adb6-2f5d7c742b57 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:25.810125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:25.811040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:25.811319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:25.812509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] PATH_INFO: `/v3/projects/374af6f93da84f54ae8baf5c5525c319/users/42073e76f8a84a78b1b12a345e46e51b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:25.829162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374af6f93da84f54ae8baf5c5525c319, user_id=42073e76f8a84a78b1b12a345e46e51b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:25.832183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:25.886225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1220/2442] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:25 2022] PUT /identity/v3/projects/374af6f93da84f54ae8baf5c5525c319/users/42073e76f8a84a78b1b12a345e46e51b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:25.893547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:25.905070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf12c8-05b9-4ab5-b9e4-ce8a86f158e4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:25.975201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:25.976080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:25.976217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:25.976462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:25.977241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:25.979405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:25.982708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:25.994278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1223/2443] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:25.998472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:26.010209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c205c3-ea8c-400e-aeb9-4c1d51a9d873 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:26.016912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fdb70-01dd-4dfc-8634-ba30f7798c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:26.018238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fdb70-01dd-4dfc-8634-ba30f7798c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:26.018850 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fdb70-01dd-4dfc-8634-ba30f7798c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:26.019130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fdb70-01dd-4dfc-8634-ba30f7798c8b admin admin] PATH_INFO: `/v3/projects/374af6f93da84f54ae8baf5c5525c319/users/42073e76f8a84a78b1b12a345e46e51b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:26.021262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fdb70-01dd-4dfc-8634-ba30f7798c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=374af6f93da84f54ae8baf5c5525c319, user_id=42073e76f8a84a78b1b12a345e46e51b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:26.024132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fdb70-01dd-4dfc-8634-ba30f7798c8b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:26.037790 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1221/2444] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:25 2022] PUT /identity/v3/projects/374af6f93da84f54ae8baf5c5525c319/users/42073e76f8a84a78b1b12a345e46e51b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:26.904077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:26.910134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:27.067785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d14faa-7d4d-4e11-8520-3e7970688a76 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:27.182208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:27.183160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:27.183891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:27.185300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:27.188293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:27.204321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:27.206211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:27.218409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1224/2445] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:27.409049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:27.409557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:27.409650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:27.444466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] MFA Rules not processed for user `42073e76f8a84a78b1b12a345e46e51b`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:27.446029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:27.532428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1222/2446] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:27 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:29.239517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:29.343670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c23dd-7d71-4213-9cbb-aba4015f26b8 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:29.349023 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:29.350004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:29.350428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:29.350804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] PATH_INFO: `/v3/users/0a955b578c3a4aa2ac319f80ea8af3f6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:29.352168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a955b578c3a4aa2ac319f80ea8af3f6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:29.354196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:29.384160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:29.582875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a955b578c3a4aa2ac319f80ea8af3f6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:29.583527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a955b578c3a4aa2ac319f80ea8af3f6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:29.649232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a955b578c3a4aa2ac319f80ea8af3f6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:29.657639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a955b578c3a4aa2ac319f80ea8af3f6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:29.658398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a955b578c3a4aa2ac319f80ea8af3f6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:29.677370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1225/2447] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:29 2022] DELETE /identity/v3/users/0a955b578c3a4aa2ac319f80ea8af3f6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:29.991747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:30.011083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a5f54-7b4f-4fa6-9169-2cca2ada6245 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:30.070113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:30.082911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:30.083782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:30.087005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:30.087005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] PATH_INFO: `/v3/projects/a4fa87d0b79f443caaf29be94df6fc3f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:30.087271 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4fa87d0b79f443caaf29be94df6fc3f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:30.090062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:30.230880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4fa87d0b79f443caaf29be94df6fc3f', 'request_id': 'req-b8f31c83-8faa-463d-b26a-c1f236b2ace1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.237577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4fa87d0b79f443caaf29be94df6fc3f', 'request_id': 'req-b8f31c83-8faa-463d-b26a-c1f236b2ace1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.244059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4fa87d0b79f443caaf29be94df6fc3f', 'request_id': 'req-b8f31c83-8faa-463d-b26a-c1f236b2ace1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.348172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] The token cache is being invalidate because project a4fa87d0b79f443caaf29be94df6fc3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:30.348551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.349334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.351218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1223/2448] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:29 2022] DELETE /identity/v3/projects/a4fa87d0b79f443caaf29be94df6fc3f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:30.356038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:30.357644 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:30.377638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb1cb9-c58b-4d9e-be8d-05f2f7f2eb90 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:30.436344 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:30.437252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:30.437537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:30.437817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] PATH_INFO: `/v3/users/42073e76f8a84a78b1b12a345e46e51b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:30.439140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=42073e76f8a84a78b1b12a345e46e51b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:30.441089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:30.640637 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42073e76f8a84a78b1b12a345e46e51b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.641358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42073e76f8a84a78b1b12a345e46e51b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.745948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42073e76f8a84a78b1b12a345e46e51b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.754661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42073e76f8a84a78b1b12a345e46e51b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.755331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d25be095-ad5e-4fee-a1ee-09f3d5868ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42073e76f8a84a78b1b12a345e46e51b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:30.772506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1226/2449] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:30 2022] DELETE /identity/v3/users/42073e76f8a84a78b1b12a345e46e51b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:31.010213 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.011719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:31.028313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f31c83-8faa-463d-b26a-c1f236b2ace1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.087234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.088102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.089011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.093080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] PATH_INFO: `/v3/projects/374af6f93da84f54ae8baf5c5525c319` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.093080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] RBAC: Authorizing `identity:delete_project(project_id=374af6f93da84f54ae8baf5c5525c319)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.093080 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:31.224115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374af6f93da84f54ae8baf5c5525c319', 'request_id': 'req-538a20f3-5e65-4e13-a46a-ff15f581428d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:31.229954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374af6f93da84f54ae8baf5c5525c319', 'request_id': 'req-538a20f3-5e65-4e13-a46a-ff15f581428d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:31.236353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374af6f93da84f54ae8baf5c5525c319', 'request_id': 'req-538a20f3-5e65-4e13-a46a-ff15f581428d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:31.337735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] The token cache is being invalidate because project 374af6f93da84f54ae8baf5c5525c319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:31.337979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:31.339132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-538a20f3-5e65-4e13-a46a-ff15f581428d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:31.340724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1224/2450] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:31 2022] DELETE /identity/v3/projects/374af6f93da84f54ae8baf5c5525c319 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:31.345581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.345874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.346154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.364972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:31.366168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:31.379125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:31.444501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1227/2451] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:31.453359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.453657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.453962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.478038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:31.479286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:31.492703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1225/2452] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:31.493824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.504149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e17e0-5621-4958-b230-f7408b141ee8 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.510002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.510002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.510002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.512943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.512943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:31.512943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.515385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:31.528643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1228/2453] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:31.530472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.534964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:31.542828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159ae70-8fa4-46a8-a47a-cab93ad2544e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.553452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.554129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.554412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.554688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.555381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.558051 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:31.691912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1226/2454] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:31 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:31.696188 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.709657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84972d-08a1-4f14-8711-a212a57d64af admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.775266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.776014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.776302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.776576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.777323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.779222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:31.861303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1229/2455] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:31 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:31.865439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.876590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ffab-03b0-4fbc-973e-1ff89d26fda2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.881525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.882201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.882504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.882779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.883620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.885276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:31.895336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1227/2456] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:31.899230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.909303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37231115-8944-4dba-99c4-efe145f8aa4c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.913989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb11f60-e8e5-4d45-a4fb-9f7fbe91921e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.914666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb11f60-e8e5-4d45-a4fb-9f7fbe91921e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.914930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb11f60-e8e5-4d45-a4fb-9f7fbe91921e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.915208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb11f60-e8e5-4d45-a4fb-9f7fbe91921e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.915937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb11f60-e8e5-4d45-a4fb-9f7fbe91921e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.918046 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb11f60-e8e5-4d45-a4fb-9f7fbe91921e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:31.927751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1230/2457] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:31.932807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:31.943256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d826f1-aba2-4304-806d-c03126120425 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:31.948128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:31.949036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:31.949317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:31.949592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] PATH_INFO: `/v3/projects/31cb2a708d8c4114a13aa3f6f08850d0/users/57492192b2c94d789c94ebc134c00d6f/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:31.965656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31cb2a708d8c4114a13aa3f6f08850d0, user_id=57492192b2c94d789c94ebc134c00d6f, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:31.968307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.037770 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1228/2458] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:31 2022] PUT /identity/v3/projects/31cb2a708d8c4114a13aa3f6f08850d0/users/57492192b2c94d789c94ebc134c00d6f/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:32.048810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.049108 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.049391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.077897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] MFA Rules not processed for user `57492192b2c94d789c94ebc134c00d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:32.079307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:32.146734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1231/2459] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:32.151423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.215921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c0b85-cf65-4342-bb81-e0e5c181a1b1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:32.220525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:32.221209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.221497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.221805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.222509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:32.224406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.323456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1229/2460] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:32 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:32.327449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.338088 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ad416-4ef0-48d4-8e0e-b42614e4c53f None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:32.350961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:32.397193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:32.398338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.398681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.398959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.399922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:32.402874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.518338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1232/2461] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:32 2022] POST /identity/v3/users => generated 295 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:32.522250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.533330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051084-b7c0-4aba-9b1b-a55c8c41297f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:32.538919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:32.544400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.544400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.544400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.544400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:32.544400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.554722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1230/2462] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:32.558970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.569367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f834750-6637-463a-9d3e-e9865b879bdf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:32.574958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:32.575894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.576177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.576454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] PATH_INFO: `/v3/projects/96db81610c2441f7a1de4c382dc8d461/users/dc296486529942668b3284868b1b1068/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.593193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=96db81610c2441f7a1de4c382dc8d461, user_id=dc296486529942668b3284868b1b1068, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:32.595918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.675483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1233/2463] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:32 2022] PUT /identity/v3/projects/96db81610c2441f7a1de4c382dc8d461/users/dc296486529942668b3284868b1b1068/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:32.679661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.689543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65899c-22dc-4298-8674-68539a408de3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:32.745188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc49fc-17c7-4189-8fb5-0226c6a71547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:32.745849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc49fc-17c7-4189-8fb5-0226c6a71547 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.746130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc49fc-17c7-4189-8fb5-0226c6a71547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.746402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc49fc-17c7-4189-8fb5-0226c6a71547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.747127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc49fc-17c7-4189-8fb5-0226c6a71547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:32.748734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc49fc-17c7-4189-8fb5-0226c6a71547 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.758602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1231/2464] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:32.763334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.773688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256f224e-b983-4650-8d61-02c1773307bb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:32.778896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:32.779770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.780054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.780331 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] PATH_INFO: `/v3/projects/96db81610c2441f7a1de4c382dc8d461/users/dc296486529942668b3284868b1b1068/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.782322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96db81610c2441f7a1de4c382dc8d461, user_id=dc296486529942668b3284868b1b1068, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:32.784989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:32.795977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1234/2465] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:32 2022] PUT /identity/v3/projects/96db81610c2441f7a1de4c382dc8d461/users/dc296486529942668b3284868b1b1068/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:32.807420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:32.807779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:32.808884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:32.838285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] MFA Rules not processed for user `dc296486529942668b3284868b1b1068`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:32.842127 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:32.847355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:32.921949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1232/2466] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:32.937732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:32.944482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:33.018070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31518ca7-4623-4485-8fcb-c57414e39a93 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:33.021670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:33.022310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:33.022589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:33.022857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:33.032330 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:33.033734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:33.044275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1235/2467] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:34.097895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:34.108101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6f538-09f2-476d-8041-b86cf42aeddd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:34.112718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc296486529942668b3284868b1b1068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96db81610c2441f7a1de4c382dc8d461', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:34.113404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:34.113694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:34.113977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:34.114714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:34.115034 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:34.116679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:34.129079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1233/2468] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:34.133215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:34.142484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693607e-c27e-431c-a43b-92c5c0e8d8d6 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:34.147148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc296486529942668b3284868b1b1068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96db81610c2441f7a1de4c382dc8d461', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:34.147843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:34.148133 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:34.148417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:34.149149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:34.151195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:34.233927 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1236/2469] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:34 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:34.237783 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:34.250831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd61a0-f4e5-4c33-aade-890f2f05eda6 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:34.323203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc296486529942668b3284868b1b1068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96db81610c2441f7a1de4c382dc8d461', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:34.324636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:34.324942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:34.325222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:34.325960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:34.326273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:34.327947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:34.328419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:34.330278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:34.345866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1234/2470] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:34.380049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:34.388656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:34.390370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ea4b2-43c4-4ac1-b222-9161065bc925 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:34.392524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27f8dd-0529-4f6c-ae0a-c8d5fc2400d2 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:34.395184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc296486529942668b3284868b1b1068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96db81610c2441f7a1de4c382dc8d461', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:34.396121 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:34.396250 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:34.396414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:34.396769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] PATH_INFO: `/v3/projects/e05b92378e2b448698aa6e0f10b900b9` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:34.396915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:34.397200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:34.397475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:34.397948 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e05b92378e2b448698aa6e0f10b900b9)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:34.402548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:34.402819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:34.465368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:34.466797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:34.476453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1237/2471] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:34.533461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05b92378e2b448698aa6e0f10b900b9', 'request_id': 'req-2f1b218a-11f5-4dad-96e6-22e8d2460729'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:34.539249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05b92378e2b448698aa6e0f10b900b9', 'request_id': 'req-2f1b218a-11f5-4dad-96e6-22e8d2460729'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:34.557032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05b92378e2b448698aa6e0f10b900b9', 'request_id': 'req-2f1b218a-11f5-4dad-96e6-22e8d2460729'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:34.629755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] The token cache is being invalidate because project e05b92378e2b448698aa6e0f10b900b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:34.630287 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:34.631648 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2f1b218a-11f5-4dad-96e6-22e8d2460729 tempest-VolumeQuotaClassesTest-92092103 tempest-VolumeQuotaClassesTest-92092103-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:34.633675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1235/2472] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:34 2022] DELETE /identity/v3/projects/e05b92378e2b448698aa6e0f10b900b9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:35.302746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:35.313029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8c3cf-ac9d-4d7c-a688-312ba86bf4cb service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:35.374883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:35.375669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:35.375948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:35.376218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] PATH_INFO: `/v3/users/57492192b2c94d789c94ebc134c00d6f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:35.377476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57492192b2c94d789c94ebc134c00d6f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:35.379379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:35.574379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57492192b2c94d789c94ebc134c00d6f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:35.575101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57492192b2c94d789c94ebc134c00d6f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:35.678458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57492192b2c94d789c94ebc134c00d6f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:35.687196 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57492192b2c94d789c94ebc134c00d6f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:35.687865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57492192b2c94d789c94ebc134c00d6f'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:35.708570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1238/2473] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:35 2022] DELETE /identity/v3/users/57492192b2c94d789c94ebc134c00d6f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:35.718876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:35.719447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:35.719554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:35.726434 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:35.740318 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:35.744502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:35.808703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1236/2474] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:35.818906 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:35.822490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:35.843552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:35.886446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aab3dd-a0ed-484c-8553-5e3daceed31e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:35.890135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:35.890734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:35.891020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:35.891296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:35.904871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:35.904871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:35.914329 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1239/2475] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:36.398757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:36.403334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:36.413771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f998549-9379-450c-b397-380b7ba1bd67 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:36.420328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:36.421982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:36.421982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:36.422151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] PATH_INFO: `/v3/projects/31cb2a708d8c4114a13aa3f6f08850d0` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:36.426816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=31cb2a708d8c4114a13aa3f6f08850d0)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:36.429113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:36.565391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31cb2a708d8c4114a13aa3f6f08850d0', 'request_id': 'req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:36.577567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31cb2a708d8c4114a13aa3f6f08850d0', 'request_id': 'req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:36.584478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31cb2a708d8c4114a13aa3f6f08850d0', 'request_id': 'req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:36.679128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] The token cache is being invalidate because project 31cb2a708d8c4114a13aa3f6f08850d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:36.679438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:36.680072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:36.681744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1237/2476] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:36 2022] DELETE /identity/v3/projects/31cb2a708d8c4114a13aa3f6f08850d0 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:36.686515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:36.697412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b822-0e70-4623-bee7-f7f6d95384db service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:36.759658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:36.759658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:36.759658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:36.759658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] PATH_INFO: `/v3/users/dc296486529942668b3284868b1b1068` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:36.762375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc296486529942668b3284868b1b1068)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:36.764396 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:36.991028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc296486529942668b3284868b1b1068'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:36.991872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc296486529942668b3284868b1b1068'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:37.111239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc296486529942668b3284868b1b1068'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:37.118799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc296486529942668b3284868b1b1068'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:37.121859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-ccfc8dc1-0b0b-420a-b447-0979f656a485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc296486529942668b3284868b1b1068'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:37.142073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1240/2477] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:36 2022] DELETE /identity/v3/users/dc296486529942668b3284868b1b1068 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:37.753946 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:37.755638 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:37.787506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce402d-4b63-4c63-a04b-4d92f21b8d7e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:37.854786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:37.855711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:37.856353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:37.856684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] PATH_INFO: `/v3/projects/96db81610c2441f7a1de4c382dc8d461` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:37.858159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=96db81610c2441f7a1de4c382dc8d461)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:37.860328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:37.989417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:38.012012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96db81610c2441f7a1de4c382dc8d461', 'request_id': 'req-e78438ab-0f09-4555-a270-ede603509ceb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.028394 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96db81610c2441f7a1de4c382dc8d461', 'request_id': 'req-e78438ab-0f09-4555-a270-ede603509ceb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.034591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96db81610c2441f7a1de4c382dc8d461', 'request_id': 'req-e78438ab-0f09-4555-a270-ede603509ceb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.111983 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] The token cache is being invalidate because project 96db81610c2441f7a1de4c382dc8d461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:38.112360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.113267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e78438ab-0f09-4555-a270-ede603509ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.114841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1238/2478] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:37 2022] DELETE /identity/v3/projects/96db81610c2441f7a1de4c382dc8d461 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:38.119765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.122581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.122581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.148510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:38.151674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:38.193161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:38.220734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1241/2479] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:38.228968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.228968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.229393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.251272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:38.252508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:38.260741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1239/2480] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:38.264981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.275742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a4a6e-66a1-4ead-8910-128a86c11348 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.280892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.281799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.282084 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.282356 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.283096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:38.283403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.285489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.301791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1242/2481] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:38.303227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.313175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb1623-9992-42f1-8c03-a1f2bfb501c1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.318295 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.318971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.319258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.319538 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.320247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.322480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.433482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1240/2482] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:38 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:38.435228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.446851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd4ff8-4566-4a9d-8d26-4c6c34cbe403 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.507889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.508395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.508712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.508996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.509681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.512213 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.540410 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.543421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:38.558342 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb05584-f15b-4b6f-b679-d188ce6023d9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.563114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.563987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.564377 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.564676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] PATH_INFO: `/v3/users/58be610f6adc46269a46db36f41d6b25` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.565872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58be610f6adc46269a46db36f41d6b25)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.567778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.612418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1243/2483] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:38 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:38.616731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.627718 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebc02d-5904-4bfa-bf37-6df37bca89cb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.632326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.633022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.633308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.633602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.634307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.635888 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.646085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1244/2484] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:38.650219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.659977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604e003-38d7-4ca7-8232-b2e5c9a5ea88 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.665037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.667494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.667494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.667494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.667758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.669799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.680324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1245/2485] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:38.685230 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.695019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a96ed1-fb73-48aa-96b2-83fb9da9dcc1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:38.700001 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570201-ac49-4b53-816e-151efbf99d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:38.700897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570201-ac49-4b53-816e-151efbf99d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.701176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570201-ac49-4b53-816e-151efbf99d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.701453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570201-ac49-4b53-816e-151efbf99d2b admin admin] PATH_INFO: `/v3/projects/ce34e79828f14e66af00b435e5c1fddb/users/1cbbd44312934b6c8627a4609be43753/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.716009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570201-ac49-4b53-816e-151efbf99d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce34e79828f14e66af00b435e5c1fddb, user_id=1cbbd44312934b6c8627a4609be43753, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:38.718682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570201-ac49-4b53-816e-151efbf99d2b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:38.837696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1246/2486] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:38 2022] PUT /identity/v3/projects/ce34e79828f14e66af00b435e5c1fddb/users/1cbbd44312934b6c8627a4609be43753/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:38.849123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:38.849279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:38.849547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:38.862971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58be610f6adc46269a46db36f41d6b25'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.877142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58be610f6adc46269a46db36f41d6b25'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.877664 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] MFA Rules not processed for user `1cbbd44312934b6c8627a4609be43753`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:38.877926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58be610f6adc46269a46db36f41d6b25'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.878898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:38.884841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58be610f6adc46269a46db36f41d6b25'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.941334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:38.946322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1247/2487] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:38.951222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:38.952513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:38.957000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58be610f6adc46269a46db36f41d6b25'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:38.964350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1241/2488] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:38 2022] DELETE /identity/v3/users/58be610f6adc46269a46db36f41d6b25 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:39.018744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffa491-698d-4280-a86f-3dd10d3facf3 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.082382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.083147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.083505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.083858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.084632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.086552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.173132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1248/2489] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:38 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:39.177119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.187721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dcc514-aa79-4e3f-a18d-00fc1a7a0b0f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.243124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.243810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.244123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.244402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.245688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.247625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.253520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.256294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:39.258782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:39.269743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401561b3-21ee-4173-b0c7-f8b490026f78 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.274842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.275704 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.276015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.276255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] PATH_INFO: `/v3/projects/d02fcd4ff818482fb04e9cdea481766f` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.277465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d02fcd4ff818482fb04e9cdea481766f)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.279365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.310305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1242/2490] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:39.313836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.324181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12f62-950d-48b1-8966-8e020ce5a045 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.329019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.329658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.329959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.330234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.330951 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.332552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.342552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1243/2491] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:39.346196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.356953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339bb82-e77c-4807-af25-bfe0dba24f7f admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.361623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.362276 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.362558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.362833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.363555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.365211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.379780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1244/2492] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:39.383074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.383203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd02fcd4ff818482fb04e9cdea481766f', 'request_id': 'req-35223832-0e19-4c9b-9f24-ae0d575de767'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:39.390028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd02fcd4ff818482fb04e9cdea481766f', 'request_id': 'req-35223832-0e19-4c9b-9f24-ae0d575de767'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:39.392884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38137f-5d00-40ce-b0f4-54c2722b8952 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.451949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e7bf-e67f-44d7-a244-2896a5d59e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.452875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e7bf-e67f-44d7-a244-2896a5d59e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.453256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e7bf-e67f-44d7-a244-2896a5d59e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.453543 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e7bf-e67f-44d7-a244-2896a5d59e87 admin admin] PATH_INFO: `/v3/projects/518c20248cb34cd498b0abf662e03cc4/users/a7166e7354264269b330537318519c4c/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.468996 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e7bf-e67f-44d7-a244-2896a5d59e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518c20248cb34cd498b0abf662e03cc4, user_id=a7166e7354264269b330537318519c4c, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.471645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e7bf-e67f-44d7-a244-2896a5d59e87 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.488569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd02fcd4ff818482fb04e9cdea481766f', 'request_id': 'req-35223832-0e19-4c9b-9f24-ae0d575de767'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:39.500715 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] The token cache is being invalidate because project d02fcd4ff818482fb04e9cdea481766f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:39.501011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:39.501766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-35223832-0e19-4c9b-9f24-ae0d575de767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:39.503321 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1249/2493] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:39 2022] DELETE /identity/v3/projects/d02fcd4ff818482fb04e9cdea481766f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:39.508320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6013ee9-96d0-4323-bcf6-0c021dce1b89 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.508706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6013ee9-96d0-4323-bcf6-0c021dce1b89 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.509049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6013ee9-96d0-4323-bcf6-0c021dce1b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.526997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f6013ee9-96d0-4323-bcf6-0c021dce1b89 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:39.528132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f6013ee9-96d0-4323-bcf6-0c021dce1b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:39.535921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1250/2494] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:39.544545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.545012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.545403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.550335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1245/2495] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:39 2022] PUT /identity/v3/projects/518c20248cb34cd498b0abf662e03cc4/users/a7166e7354264269b330537318519c4c/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:39.562226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.562546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.562827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.565596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:39.570293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:39.571211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:39.593042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] MFA Rules not processed for user `a7166e7354264269b330537318519c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:39.596329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:39.631150 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1251/2496] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:39.635992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.645871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fd41bc-dd9a-4300-8362-aee83ae0be85 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.650547 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.651809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.652096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.652377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.653160 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:39.653469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.655096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.661617 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1246/2497] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:39.666017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.667782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:39.671296 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1252/2498] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:41:39.674951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.681145 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8cc807-8fe4-4e71-a84c-d76771eff64e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.686098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b212f9-8963-4d7b-9fcb-ebd0ab287d7b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.686643 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.687354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.687641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.687917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.688625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.690544 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.699951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.706384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.706384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.706384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.706384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.706384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.855705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1247/2499] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:39.859489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.874220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1253/2500] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/projects => generated 363 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:39.878504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:39.882986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:39.924657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb982e-bfb2-444d-97ba-cba90777c3a9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.942404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27a38-c35e-4d24-bd78-c68bed40295e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:39.947357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.948020 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.948297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.951090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.951090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.951292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:39.983026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:39.983779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:39.984069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:39.984382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:39.985133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:39.987040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.059798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1254/2501] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:40.063762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.073912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867fc63-ee3c-4ca4-8d06-2e4c34f69cce admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.078546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.079172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.079460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.079737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.080449 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.082129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.093326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1248/2502] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:39 2022] POST /identity/v3/users => generated 300 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:40.093507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1255/2503] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:40.094577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.096216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.104876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b684c7-09ba-4382-ae44-e09e69518bc5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.105710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e6426-e2c1-4b2d-86a3-0bcc2602ca45 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.109651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.110294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.110415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.110588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.110865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.110984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.111228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.111505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.111611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.112215 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.113346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.113810 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.126340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1249/2504] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:40.126519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1256/2505] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:40.127421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.127583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.137757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c383b9d-3e5d-44e0-b4d4-f2107c93f1ed admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.137907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6f8da-693c-42c7-9990-98ddb08cb174 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.142458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f07426-835c-4984-9818-f54763b22980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.142605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.143369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07426-835c-4984-9818-f54763b22980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.143482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.143654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07426-835c-4984-9818-f54763b22980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.143753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.143932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f07426-835c-4984-9818-f54763b22980 admin admin] PATH_INFO: `/v3/projects/e2fc1d76083f4404b96b8c47db6b6254/users/1c62e11c80c245c193468b83c321d71c/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.144040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] PATH_INFO: `/v3/projects/1eec67024d5e4f0bbe5d04c067cc5cba/users/2ca4112f69114b62a6a480ca545b41ce/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.159482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07426-835c-4984-9818-f54763b22980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fc1d76083f4404b96b8c47db6b6254, user_id=1c62e11c80c245c193468b83c321d71c, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.159809 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eec67024d5e4f0bbe5d04c067cc5cba, user_id=2ca4112f69114b62a6a480ca545b41ce, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.162353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f07426-835c-4984-9818-f54763b22980 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.162607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.225125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1250/2506] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:40 2022] PUT /identity/v3/projects/1eec67024d5e4f0bbe5d04c067cc5cba/users/2ca4112f69114b62a6a480ca545b41ce/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:40.228873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.237012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1257/2507] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:40 2022] PUT /identity/v3/projects/e2fc1d76083f4404b96b8c47db6b6254/users/1c62e11c80c245c193468b83c321d71c/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:40.247545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.247839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.248123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.273497 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] MFA Rules not processed for user `1c62e11c80c245c193468b83c321d71c`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:40.274686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:40.279684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:40.291290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcef40-d2e5-4901-892f-98cc9a38f98e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.318032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:40.340087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1258/2508] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:40.348252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.349001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.349284 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.349559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.350292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.351595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.351880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.353035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:40.366306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1251/2509] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:40.367328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.377406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f237c-a2cb-476d-ac1e-48b5e91a5af4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.382005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453aab0-d4c9-4675-8b64-36aff7b8f090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.382889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453aab0-d4c9-4675-8b64-36aff7b8f090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.383167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453aab0-d4c9-4675-8b64-36aff7b8f090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.383439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453aab0-d4c9-4675-8b64-36aff7b8f090 admin admin] PATH_INFO: `/v3/projects/1eec67024d5e4f0bbe5d04c067cc5cba/users/2ca4112f69114b62a6a480ca545b41ce/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.385486 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453aab0-d4c9-4675-8b64-36aff7b8f090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eec67024d5e4f0bbe5d04c067cc5cba, user_id=2ca4112f69114b62a6a480ca545b41ce, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.388905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453aab0-d4c9-4675-8b64-36aff7b8f090 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.399052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1252/2510] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:40 2022] PUT /identity/v3/projects/1eec67024d5e4f0bbe5d04c067cc5cba/users/2ca4112f69114b62a6a480ca545b41ce/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:40.409340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.409626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.409897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.410865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46f11-3c3f-4feb-98a3-5750200b86ec None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.436864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] MFA Rules not processed for user `2ca4112f69114b62a6a480ca545b41ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:40.438057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:40.459047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.459695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.460000 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.460282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.506063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1253/2511] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:40.516626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.517077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:40.518094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.518500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:40.527563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1259/2512] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:40.531808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad555dc-f157-4a30-8e02-51ac84e5ce57 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:40.535590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:40.536231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:40.536514 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:40.536823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:40.546932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:40.548355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:40.562392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1254/2513] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:41.685865 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:41.694570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a1db43-e18f-4cd7-9f6a-ab4058473dd2 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:41.698938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:41.699639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:41.699967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:41.700235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:41.702214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:41.716761 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:41.762930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:41.764399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e95d80-0e07-4b1c-9ceb-00c35a5a91bc service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:41.773375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1260/2514] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:46.804726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:46.813168 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86202ff-fe56-4fff-b98b-fc60672f6fb9 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:46.816928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:46.817497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:46.817781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:46.818061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:46.875504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:46.876942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:46.885897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1255/2515] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:47.186334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:47.186900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:47.187057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:47.206300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:47.207576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:47.269953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1261/2516] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:47.284317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:47.288931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:47.312112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:47.359919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4c6ba-9cc3-4a48-914d-a7ad5ea8773a service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:47.365583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c00ec-29b9-43d2-bd46-bc95300b63a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:47.366167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c00ec-29b9-43d2-bd46-bc95300b63a3 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:47.366462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c00ec-29b9-43d2-bd46-bc95300b63a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:47.366735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c00ec-29b9-43d2-bd46-bc95300b63a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:47.375485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c00ec-29b9-43d2-bd46-bc95300b63a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:47.377111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c00ec-29b9-43d2-bd46-bc95300b63a3 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:47.386696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1256/2517] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:50.443663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:50.453712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192d895-562b-4e2d-bb1f-4aab5fb23bf7 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:50.458415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:50.459328 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:50.459610 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:50.459882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] PATH_INFO: `/v3/users/1c62e11c80c245c193468b83c321d71c` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:50.461145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c62e11c80c245c193468b83c321d71c)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:50.463034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:50.715339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c62e11c80c245c193468b83c321d71c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:50.721246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c62e11c80c245c193468b83c321d71c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:50.790775 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c62e11c80c245c193468b83c321d71c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:50.798941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c62e11c80c245c193468b83c321d71c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:50.799512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c62e11c80c245c193468b83c321d71c'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:50.817419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1262/2518] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:50 2022] DELETE /identity/v3/users/1c62e11c80c245c193468b83c321d71c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:50.822264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:50.822743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:50.822864 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:50.840372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:50.841602 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:50.903000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1257/2519] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:50.912762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:50.914276 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:50.947366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:50.972107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:50.973824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:50.978243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23657c-b59e-4326-8868-f1510964d517 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:50.982687 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264efc0-44ae-4fc7-89a1-7dae9868e98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:50.985287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264efc0-44ae-4fc7-89a1-7dae9868e98b service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:50.985287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264efc0-44ae-4fc7-89a1-7dae9868e98b service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:50.985287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264efc0-44ae-4fc7-89a1-7dae9868e98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:50.986818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b440-78af-47a5-86bb-17a0173b92ce None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:50.991372 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:50.992234 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:50.992607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:50.992842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] PATH_INFO: `/v3/users/1cbbd44312934b6c8627a4609be43753` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:50.994075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cbbd44312934b6c8627a4609be43753)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:50.995976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.000042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264efc0-44ae-4fc7-89a1-7dae9868e98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:51.002353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264efc0-44ae-4fc7-89a1-7dae9868e98b service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.013202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1263/2520] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:51.204729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cbbd44312934b6c8627a4609be43753'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.217609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cbbd44312934b6c8627a4609be43753'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.218306 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cbbd44312934b6c8627a4609be43753'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.225528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cbbd44312934b6c8627a4609be43753'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.302562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cbbd44312934b6c8627a4609be43753'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.309548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1258/2521] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:50 2022] DELETE /identity/v3/users/1cbbd44312934b6c8627a4609be43753 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:51.314505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.314830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.315136 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.342495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:51.342495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.397926 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1264/2522] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:51.407885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:51.409333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.426636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:51.428062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.435969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:51.454620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b40d1f-394d-4ae0-a4b7-89f334ef6167 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:51.459694 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:51.460701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.461199 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.470204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] PATH_INFO: `/v3/projects/e2fc1d76083f4404b96b8c47db6b6254` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.470204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2fc1d76083f4404b96b8c47db6b6254)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:51.470204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.479565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9b894-5a78-424c-9c82-f73e8883b775 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:51.483440 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fd422-8502-42c1-b2bf-73e9c16e4b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:51.484247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd422-8502-42c1-b2bf-73e9c16e4b83 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.484674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd422-8502-42c1-b2bf-73e9c16e4b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.485047 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fd422-8502-42c1-b2bf-73e9c16e4b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.497485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fd422-8502-42c1-b2bf-73e9c16e4b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:51.498913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30fd422-8502-42c1-b2bf-73e9c16e4b83 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.509601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1259/2523] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:51.533868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.534142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.534523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.562811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:51.564163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.573246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1260/2524] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:51.595212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:51.597594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.609241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2fc1d76083f4404b96b8c47db6b6254', 'request_id': 'req-a9413ada-e3f4-4141-a3fd-306b2d0455ed'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.618177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2fc1d76083f4404b96b8c47db6b6254', 'request_id': 'req-a9413ada-e3f4-4141-a3fd-306b2d0455ed'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.676723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d6c59-9abe-4890-9632-6db0ff6f23ec None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:51.697124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2fc1d76083f4404b96b8c47db6b6254', 'request_id': 'req-a9413ada-e3f4-4141-a3fd-306b2d0455ed'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.717398 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] The token cache is being invalidate because project e2fc1d76083f4404b96b8c47db6b6254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:51.717922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.719259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-a9413ada-e3f4-4141-a3fd-306b2d0455ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:51.721178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1265/2525] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:51 2022] DELETE /identity/v3/projects/e2fc1d76083f4404b96b8c47db6b6254 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:51.725814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2588b-aa58-4dcc-8170-c96c1bcaabba None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.726101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2588b-aa58-4dcc-8170-c96c1bcaabba None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.728754 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2588b-aa58-4dcc-8170-c96c1bcaabba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.750155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:51.750897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.751248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.751588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.754371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.760548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-90c2588b-aa58-4dcc-8170-c96c1bcaabba None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:51.760548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-90c2588b-aa58-4dcc-8170-c96c1bcaabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.819288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:51.820705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:51.831918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1266/2526] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:51.835335 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:51.837096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.839352 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.839643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.839948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.847942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1261/2527] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:51.859649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:51.860897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:51.869661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1267/2528] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:51.874702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:51.884804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749bcb0-c0ec-4364-b8af-1f5abb5a5fc0 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:51.889873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:51.890535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.890818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.891124 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.891886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:51.892321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:51.893941 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.913606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1262/2529] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:51.917634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:51.927915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d4368-4c95-4c96-b156-7c0fbb22cd37 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:51.932821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:51.933581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:51.934544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:51.934869 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:51.935551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:51.937769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:51.989866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:51.991620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:52.004870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c346e0-9474-446c-9c17-3ea96f40906b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.009485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.010334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.010642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.010918 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] PATH_INFO: `/v3/projects/ce34e79828f14e66af00b435e5c1fddb` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.015937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce34e79828f14e66af00b435e5c1fddb)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.015937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.061307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1268/2530] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:51 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:52.065060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.129663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc9a88-ba62-45f6-aad8-9f837ad275bb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.136330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce34e79828f14e66af00b435e5c1fddb', 'request_id': 'req-6f3334c8-00df-43c2-ba9e-a226ebdffedc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.142246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce34e79828f14e66af00b435e5c1fddb', 'request_id': 'req-6f3334c8-00df-43c2-ba9e-a226ebdffedc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.149041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce34e79828f14e66af00b435e5c1fddb', 'request_id': 'req-6f3334c8-00df-43c2-ba9e-a226ebdffedc'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.189050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.189712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.189994 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.190269 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.190964 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.192874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.263875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] The token cache is being invalidate because project ce34e79828f14e66af00b435e5c1fddb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:52.264187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.264843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.266422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1263/2531] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:51 2022] DELETE /identity/v3/projects/ce34e79828f14e66af00b435e5c1fddb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:52.270142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.271504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:52.284331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3334c8-00df-43c2-ba9e-a226ebdffedc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.289464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.292083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.292083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.292083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] PATH_INFO: `/v3/users/a7166e7354264269b330537318519c4c` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.292083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7166e7354264269b330537318519c4c)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.297237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1269/2532] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:52 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:41:52.297382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.298239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.299875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:52.311707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45520e20-ca52-4412-84a2-90471ce6e37b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.316759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.317408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.317728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.318013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.318743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.320333 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.330646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1270/2533] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:52.334446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.344217 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddb2fc-a1c6-4493-abb5-a96f4e66cadf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.348868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.349517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.349805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.350083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.350773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.352294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.367519 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1271/2534] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:52.372548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.378312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef000-5e81-46d9-9b16-b5ae5ae8cf6a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.382951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eae634-10c8-4ce5-979c-79172b65994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.383795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae634-10c8-4ce5-979c-79172b65994d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.384081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae634-10c8-4ce5-979c-79172b65994d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.384446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eae634-10c8-4ce5-979c-79172b65994d admin admin] PATH_INFO: `/v3/projects/d67a4a2adc0349bb896a9e4beff60e7d/users/28957dcc1fff4013905b17bb75ddf6f0/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.399390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eae634-10c8-4ce5-979c-79172b65994d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67a4a2adc0349bb896a9e4beff60e7d, user_id=28957dcc1fff4013905b17bb75ddf6f0, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.402064 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eae634-10c8-4ce5-979c-79172b65994d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.455698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7166e7354264269b330537318519c4c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.468508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7166e7354264269b330537318519c4c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.469222 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7166e7354264269b330537318519c4c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.472649 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1272/2535] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:52 2022] PUT /identity/v3/projects/d67a4a2adc0349bb896a9e4beff60e7d/users/28957dcc1fff4013905b17bb75ddf6f0/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:52.476111 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7166e7354264269b330537318519c4c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.483619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.483939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.484236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.501475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:52.509516 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] MFA Rules not processed for user `28957dcc1fff4013905b17bb75ddf6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:52.510699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:52.567406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7166e7354264269b330537318519c4c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:52.573978 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1273/2536] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:52.574911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1264/2537] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:52 2022] DELETE /identity/v3/users/a7166e7354264269b330537318519c4c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:52.578955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.580245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:52.643140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36966ea5-30ec-4e5d-8aa0-77a07ecfcd09 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.698437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.699639 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.699923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.700198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.700927 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.703036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.787876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1274/2538] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:52 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:52.791763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.801761 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc206c92-86cc-4dd1-8ee4-5a79144ecbf7 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.829885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:52.861329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.862019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.862301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.862605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.867532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.867532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.951600 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1265/2539] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:52 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:52.955595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:52.965752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e62350-512f-4497-9523-e09bb07dc351 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:52.970533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:52.971182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:52.971518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:52.971804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:52.972526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:52.974205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:52.985615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1275/2540] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:52.989673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.000286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972faf2c-a44e-4da7-a8da-3a491261fd71 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.004835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.005695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.006018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.006296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] PATH_INFO: `/v3/projects/fe5e1708c8c24d07b7660508e32b70fe/users/fc62e91278364dfa8d6e61145e86cf22/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.026868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.029038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:53.029729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5e1708c8c24d07b7660508e32b70fe, user_id=fc62e91278364dfa8d6e61145e86cf22, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.032414 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.043625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1300-5241-495a-a9ab-327e6e7b91a8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.048924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.049843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.050124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.052135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] PATH_INFO: `/v3/projects/518c20248cb34cd498b0abf662e03cc4` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.052135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=518c20248cb34cd498b0abf662e03cc4)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.053695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.070418 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:53.099444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1266/2541] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:52 2022] PUT /identity/v3/projects/fe5e1708c8c24d07b7660508e32b70fe/users/fc62e91278364dfa8d6e61145e86cf22/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:53.103209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.168542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a77c11-f207-460d-8715-abc2b93ab0f5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.187016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518c20248cb34cd498b0abf662e03cc4', 'request_id': 'req-157e1e77-7947-4dd5-838b-d08e338663bf'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.195357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518c20248cb34cd498b0abf662e03cc4', 'request_id': 'req-157e1e77-7947-4dd5-838b-d08e338663bf'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.225032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.225710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.225995 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.226270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.227010 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.228593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.239349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1267/2542] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:41:53.243449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.253496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e621-ec8b-4d1f-8876-b855d5c5b1a1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.258129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.258966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.259247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.259523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] PATH_INFO: `/v3/projects/fe5e1708c8c24d07b7660508e32b70fe/users/fc62e91278364dfa8d6e61145e86cf22/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.261533 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe5e1708c8c24d07b7660508e32b70fe, user_id=fc62e91278364dfa8d6e61145e86cf22, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.261893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518c20248cb34cd498b0abf662e03cc4', 'request_id': 'req-157e1e77-7947-4dd5-838b-d08e338663bf'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.264226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.273039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] The token cache is being invalidate because project 518c20248cb34cd498b0abf662e03cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:53.273388 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.274028 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-157e1e77-7947-4dd5-838b-d08e338663bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.274625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1268/2543] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:53 2022] PUT /identity/v3/projects/fe5e1708c8c24d07b7660508e32b70fe/users/fc62e91278364dfa8d6e61145e86cf22/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:53.275681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1276/2544] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:53 2022] DELETE /identity/v3/projects/518c20248cb34cd498b0abf662e03cc4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:41:53.283660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.284633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61521be-7c31-4771-a825-b16be881090a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.285010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61521be-7c31-4771-a825-b16be881090a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.285380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61521be-7c31-4771-a825-b16be881090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.285484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:53.313663 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e61521be-7c31-4771-a825-b16be881090a None None] MFA Rules not processed for user `fc62e91278364dfa8d6e61145e86cf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:53.314446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:53.315022 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e61521be-7c31-4771-a825-b16be881090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:53.351919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b674-3d5c-42bb-82a1-d58a61a07a07 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.357623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.358507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.358798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.359077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] PATH_INFO: `/v3/users/2ca4112f69114b62a6a480ca545b41ce` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.360290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca4112f69114b62a6a480ca545b41ce)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.362278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.383314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1277/2545] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:53.394667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61521be-7c31-4771-a825-b16be881090a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.396008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e61521be-7c31-4771-a825-b16be881090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:53.451656 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61521be-7c31-4771-a825-b16be881090a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.455220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.455853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.456135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.456411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.465725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.467219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.476526 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1278/2546] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:53.573537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca4112f69114b62a6a480ca545b41ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.587014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca4112f69114b62a6a480ca545b41ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.587725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca4112f69114b62a6a480ca545b41ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.595461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca4112f69114b62a6a480ca545b41ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.679045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca4112f69114b62a6a480ca545b41ce'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:53.691326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1269/2547] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:53 2022] DELETE /identity/v3/users/2ca4112f69114b62a6a480ca545b41ce => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:53.698292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:53.707027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53d15e-6ec1-40e0-9c43-0e98404e0f69 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:53.736814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:53.759590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:53.760326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:53.760608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:53.760905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:53.762785 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:53.821997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:53.823415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1da0c-5245-4e1f-8986-f2724b661c93 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:53.832102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1279/2548] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:54.166449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:54.167914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:54.265179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d9d76-a1b8-4d76-8feb-8e8bd1cf15d9 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:54.269709 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:54.270571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:54.270854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:54.271129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] PATH_INFO: `/v3/projects/1eec67024d5e4f0bbe5d04c067cc5cba` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:54.272313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eec67024d5e4f0bbe5d04c067cc5cba)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:54.274280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:54.399786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:54.402555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eec67024d5e4f0bbe5d04c067cc5cba', 'request_id': 'req-061a49d2-e84e-4fbe-bf9c-cc00217c1317'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:54.408077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eec67024d5e4f0bbe5d04c067cc5cba', 'request_id': 'req-061a49d2-e84e-4fbe-bf9c-cc00217c1317'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:54.414152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eec67024d5e4f0bbe5d04c067cc5cba', 'request_id': 'req-061a49d2-e84e-4fbe-bf9c-cc00217c1317'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:54.502892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] The token cache is being invalidate because project 1eec67024d5e4f0bbe5d04c067cc5cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:41:54.503107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:54.503730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-061a49d2-e84e-4fbe-bf9c-cc00217c1317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:54.505310 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1270/2549] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:41:54 2022] DELETE /identity/v3/projects/1eec67024d5e4f0bbe5d04c067cc5cba => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:54.511183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:54.512185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:54.512384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:54.529707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:54.530989 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:54.591055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1280/2550] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:54.599636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:54.599934 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:54.600210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:54.618443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:54.620129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:54.628649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1271/2551] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:54.633887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:54.644291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fd275-f1ad-43e7-ac47-47b42418247c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:54.648931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:54.649571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:54.649847 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:54.650120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:54.650830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:41:54.651326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:54.652923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:54.666012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1281/2552] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:41:54.669028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:54.678240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8688a-255a-4ac4-b758-dc2b11e38686 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:54.682930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:54.684125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:54.684419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:54.684729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:54.685419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:54.687311 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:54.791748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1272/2553] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:54 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:54.793594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:54.803722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f432d30-40ff-48f3-a4cc-fd119079771e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:54.858520 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:54.859177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:54.859462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:54.859736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:54.860415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:54.862376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:54.982736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1282/2554] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:54 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:54.986822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:54.997523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a3f49-2073-4213-a9e9-eb44c51b0337 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.003161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.003813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.004100 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.004378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.005150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.006736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.017037 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1273/2555] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:55.020832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.025949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:55.031894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03869c6e-0780-47a8-bb44-7bed3fceaffa admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.036634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92ca8c-77b6-4579-b074-d8ece6093c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.037285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92ca8c-77b6-4579-b074-d8ece6093c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.040094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92ca8c-77b6-4579-b074-d8ece6093c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.040094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92ca8c-77b6-4579-b074-d8ece6093c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.040094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92ca8c-77b6-4579-b074-d8ece6093c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.040094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92ca8c-77b6-4579-b074-d8ece6093c4b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.051634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1283/2556] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:55.055620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.065693 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5de722-f94e-47c5-bede-6e3007e458f2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.070423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.071316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.071875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.074735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] PATH_INFO: `/v3/projects/983f21eba9d94f56b72976c19aadd1ba/users/6f6ce163baa34f11b42741c783bd5678/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.087980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] RBAC: Authorizing `identity:create_grant(project_id=983f21eba9d94f56b72976c19aadd1ba, user_id=6f6ce163baa34f11b42741c783bd5678, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.091176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.172256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1274/2557] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:55 2022] PUT /identity/v3/projects/983f21eba9d94f56b72976c19aadd1ba/users/6f6ce163baa34f11b42741c783bd5678/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:55.183115 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.183476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.183755 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.210938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] MFA Rules not processed for user `6f6ce163baa34f11b42741c783bd5678`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:55.212173 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:55.284898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1284/2558] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:55.289215 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.352967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15490f-8d2a-48aa-bc98-3f52b13d801e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.358338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.358998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.359283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.359556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.360265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.362197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.466909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1275/2559] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:41:55 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:55.470962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.482029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3128f-cfe0-4508-8422-7b99add237ad None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.546922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.547602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.548295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.548295 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.549073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.550910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.648113 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1285/2560] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:41:55 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:41:55.651468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.662139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4736788-772a-48a6-be28-a3ab975ad561 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.667170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.667848 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.668125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.668396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.669207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.670814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.681685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1276/2561] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:55.689716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.702458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebde8cd-d8d1-4721-9966-d5b3bd418a60 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.708957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.709914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.711222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.711222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] PATH_INFO: `/v3/projects/78ca540471bd493f8bf23200f9450829/users/c4ca6db9d22740cdb29835659859ce6b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.729854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ca540471bd493f8bf23200f9450829, user_id=c4ca6db9d22740cdb29835659859ce6b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.739102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.816602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1286/2562] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:55 2022] PUT /identity/v3/projects/78ca540471bd493f8bf23200f9450829/users/c4ca6db9d22740cdb29835659859ce6b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:55.820462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.831344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc9bd0-699a-49ff-a24f-f37af5b4b3c5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.873463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:55.890832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897de9ac-b3f1-4294-89c8-881713a7cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.895636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de9ac-b3f1-4294-89c8-881713a7cc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.895636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de9ac-b3f1-4294-89c8-881713a7cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.895636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897de9ac-b3f1-4294-89c8-881713a7cc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.895636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897de9ac-b3f1-4294-89c8-881713a7cc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.895636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897de9ac-b3f1-4294-89c8-881713a7cc1b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.906859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1277/2563] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:41:55.911234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:55.922534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528301ff-23be-4e0e-ae23-ea0d334c3d1a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:55.927450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:55.928339 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.928629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.928915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] PATH_INFO: `/v3/projects/78ca540471bd493f8bf23200f9450829/users/c4ca6db9d22740cdb29835659859ce6b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.930977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ca540471bd493f8bf23200f9450829, user_id=c4ca6db9d22740cdb29835659859ce6b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:55.934410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:55.945919 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1287/2564] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:41:55 2022] PUT /identity/v3/projects/78ca540471bd493f8bf23200f9450829/users/c4ca6db9d22740cdb29835659859ce6b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:55.962258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a33512-0cb4-46d4-af67-e8f3dfae6e63 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:55.962551 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a33512-0cb4-46d4-af67-e8f3dfae6e63 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:55.962900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a33512-0cb4-46d4-af67-e8f3dfae6e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:55.992444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c4a33512-0cb4-46d4-af67-e8f3dfae6e63 None None] MFA Rules not processed for user `c4ca6db9d22740cdb29835659859ce6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:55.996968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c4a33512-0cb4-46d4-af67-e8f3dfae6e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:56.067178 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1278/2565] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:56.079167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:56.080857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:56.114851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:56.135826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:56.136123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:56.137002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:56.138298 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d44ccf-4a0a-498f-975d-2d8abc4ee884 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:56.141975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:56.142617 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:56.142938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:56.143220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:56.152808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:56.158908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:56.159025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:56.159025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:56.164214 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1288/2566] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:56 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:56.219546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1279/2567] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:41:56.249523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:56.251320 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:56.272281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:56.283134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370db8a0-7efc-4100-aa98-51c7f1968e99 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:56.287039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c62e5-bbb4-436f-98f3-08d8f143766e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:56.289893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c62e5-bbb4-436f-98f3-08d8f143766e service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:56.289893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c62e5-bbb4-436f-98f3-08d8f143766e service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:56.289893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c62e5-bbb4-436f-98f3-08d8f143766e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:56.328124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051179ca-d3df-4f63-955d-af494b33441b service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:56.333954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:56.334604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:56.334887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:56.335175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:56.345842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:56.347550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:56.353104 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c62e5-bbb4-436f-98f3-08d8f143766e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:56.357995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1289/2568] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:41:56.359810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c62e5-bbb4-436f-98f3-08d8f143766e service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:56.369452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1280/2569] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:41:59.397620 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:59.407924 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761986a-1ead-440c-b19d-ea590d8c4586 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:59.412442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:59.415470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:59.415470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:59.415470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] PATH_INFO: `/v3/users/6f6ce163baa34f11b42741c783bd5678` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:59.415470 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6ce163baa34f11b42741c783bd5678)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:59.417099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:59.633488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6ce163baa34f11b42741c783bd5678'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:59.634132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6ce163baa34f11b42741c783bd5678'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:59.764898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6ce163baa34f11b42741c783bd5678'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:59.772428 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6ce163baa34f11b42741c783bd5678'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:59.773130 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6ce163baa34f11b42741c783bd5678'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:41:59.791245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1290/2570] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:41:59 2022] DELETE /identity/v3/users/6f6ce163baa34f11b42741c783bd5678 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:41:59.794411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2bddf-d092-4140-97e1-557194bc67cf None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:59.794866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2bddf-d092-4140-97e1-557194bc67cf None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:59.794981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2bddf-d092-4140-97e1-557194bc67cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:59.801748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:59.812730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-08c2bddf-d092-4140-97e1-557194bc67cf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:41:59.813927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-08c2bddf-d092-4140-97e1-557194bc67cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:59.874914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1281/2571] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:41:59.885035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:41:59.887208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:41:59.929290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:41:59.950889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084d729-fdc5-4edf-b7b8-9d679d6a62cc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:41:59.954503 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:41:59.955165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:41:59.955446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:41:59.955721 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:41:59.964366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:41:59.965815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:41:59.974902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1291/2572] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:00.026801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:00.027147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:00.027431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:00.046417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:00.047629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:00.058592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1282/2573] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:00.076377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:00.077808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:00.150077 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081196d-236f-4a2b-bc2e-a3013ec1fe55 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:00.155667 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:00.156312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:00.156592 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:00.156896 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:00.165560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:00.167197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:00.177650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1292/2574] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:00.442685 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:00.444144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:00.456264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859e1a-d4c9-4fb2-9725-b58ecdd2e6b9 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:00.461006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:00.461857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:00.462140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:00.462418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] PATH_INFO: `/v3/projects/983f21eba9d94f56b72976c19aadd1ba` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:00.463626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983f21eba9d94f56b72976c19aadd1ba)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:00.466088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:00.587189 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983f21eba9d94f56b72976c19aadd1ba', 'request_id': 'req-9724f8dd-80b8-4069-846f-27d99f3f4810'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:00.593378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983f21eba9d94f56b72976c19aadd1ba', 'request_id': 'req-9724f8dd-80b8-4069-846f-27d99f3f4810'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:00.599390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983f21eba9d94f56b72976c19aadd1ba', 'request_id': 'req-9724f8dd-80b8-4069-846f-27d99f3f4810'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:00.695621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] The token cache is being invalidate because project 983f21eba9d94f56b72976c19aadd1ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:00.695910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:00.696817 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:00.698383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1283/2575] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:00 2022] DELETE /identity/v3/projects/983f21eba9d94f56b72976c19aadd1ba => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:00.703477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:00.712140 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0338fd-eeec-4c4b-9c22-1f997ed85281 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:00.770008 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:00.770987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:00.771282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:00.771541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] PATH_INFO: `/v3/users/c4ca6db9d22740cdb29835659859ce6b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:00.772763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ca6db9d22740cdb29835659859ce6b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:00.774729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:01.029800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ca6db9d22740cdb29835659859ce6b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.030458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ca6db9d22740cdb29835659859ce6b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.111616 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ca6db9d22740cdb29835659859ce6b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.120161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ca6db9d22740cdb29835659859ce6b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.121486 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-28648215-06d2-460c-a818-cd27df285bc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ca6db9d22740cdb29835659859ce6b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.122832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:01.148963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1293/2576] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:00 2022] DELETE /identity/v3/users/c4ca6db9d22740cdb29835659859ce6b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:01.594675 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:01.600136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:01.621752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724f8dd-80b8-4069-846f-27d99f3f4810 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:01.683887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:01.684830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:01.685062 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:01.685389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] PATH_INFO: `/v3/projects/78ca540471bd493f8bf23200f9450829` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:01.686555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ca540471bd493f8bf23200f9450829)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:01.688564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:01.715577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:01.817765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ca540471bd493f8bf23200f9450829', 'request_id': 'req-2dc433a9-3061-473a-91bb-17b93f19ced9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.834630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ca540471bd493f8bf23200f9450829', 'request_id': 'req-2dc433a9-3061-473a-91bb-17b93f19ced9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.842987 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ca540471bd493f8bf23200f9450829', 'request_id': 'req-2dc433a9-3061-473a-91bb-17b93f19ced9'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.978650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] The token cache is being invalidate because project 78ca540471bd493f8bf23200f9450829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:01.982689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.982689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2dc433a9-3061-473a-91bb-17b93f19ced9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:01.983078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1284/2577] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:01 2022] DELETE /identity/v3/projects/78ca540471bd493f8bf23200f9450829 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:01.987949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:01.989378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:01.989378 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.010626 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:02.012657 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:02.083491 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1294/2578] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:02.093187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.093477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.093760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.114498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:02.115734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:02.126275 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1285/2579] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:02.128421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.139441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282795eb-289d-4a30-a60e-724a7d3f85e9 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.144445 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.147410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.147410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.147410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.147410 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:02.147950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.149074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.166081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1295/2580] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:42:02.167435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.177413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799e666-c127-45b3-a3a8-2bed279916a0 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.188669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.189347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.189645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.189923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.190680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.192676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.298289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1286/2581] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:02 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:02.300157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.311712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf73d54-0ac5-4d71-8eeb-268da60fc0a8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.377323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.378176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.378472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.378753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.379456 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.381737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.476154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1296/2582] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:02 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:02.481597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.493779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.495901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:02.499076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37695c-71a7-4ade-92c7-ab36d2e3f2cc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.504309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.508029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.508029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.508029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.508029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.508649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.509563 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b8b01-36c4-4407-8f0d-ece8e1112ee6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.515995 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.516893 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.517179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.517460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] PATH_INFO: `/v3/users/28957dcc1fff4013905b17bb75ddf6f0` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.518701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28957dcc1fff4013905b17bb75ddf6f0)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.520678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.523491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1287/2583] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:02.528420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.540796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5ecdd-081f-45b4-99fe-51677042baa3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.548827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.549504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.549851 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.550119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.552831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.552967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.564353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1288/2584] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:02.568042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.578827 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912589fc-e39f-497a-ad76-db08602971f4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:02.583612 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ecd46-87d6-4e67-9be9-05caf52b831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:02.584491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ecd46-87d6-4e67-9be9-05caf52b831d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.584807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ecd46-87d6-4e67-9be9-05caf52b831d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.585083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ecd46-87d6-4e67-9be9-05caf52b831d admin admin] PATH_INFO: `/v3/projects/060a814c02114fae81295637f7bd8172/users/dc3a1618766e421bb46c723fe6304531/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.604813 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ecd46-87d6-4e67-9be9-05caf52b831d admin admin] RBAC: Authorizing `identity:create_grant(project_id=060a814c02114fae81295637f7bd8172, user_id=dc3a1618766e421bb46c723fe6304531, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:02.607964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ecd46-87d6-4e67-9be9-05caf52b831d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:02.779541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1289/2585] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:02 2022] PUT /identity/v3/projects/060a814c02114fae81295637f7bd8172/users/dc3a1618766e421bb46c723fe6304531/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:02.787799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28957dcc1fff4013905b17bb75ddf6f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:02.788973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28957dcc1fff4013905b17bb75ddf6f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:02.790025 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.790387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.790906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.792795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:02.825718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] MFA Rules not processed for user `dc3a1618766e421bb46c723fe6304531`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:02.826975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:02.896372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28957dcc1fff4013905b17bb75ddf6f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:02.897875 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1290/2586] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:02.902205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:02.904364 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28957dcc1fff4013905b17bb75ddf6f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:02.905155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-861bcb30-377a-4638-bb4c-8cc13941705c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28957dcc1fff4013905b17bb75ddf6f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:02.925424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1297/2587] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:02 2022] DELETE /identity/v3/users/28957dcc1fff4013905b17bb75ddf6f0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:02.929624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:02.930025 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:02.931169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:02.947768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:02.951178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:02.952434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:02.980650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c9353b-90ed-4f83-8e69-9320a1018096 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.012076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1298/2588] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:03.023032 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.024778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.045944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba6690-430b-415d-956e-49557685ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.046915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6690-430b-415d-956e-49557685ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.047355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6690-430b-415d-956e-49557685ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.047786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba6690-430b-415d-956e-49557685ebc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.048714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba6690-430b-415d-956e-49557685ebc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.050591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba6690-430b-415d-956e-49557685ebc6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.086380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2defe0c-b80e-40ab-b390-22a27fecb197 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.091169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.091814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.092094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.092369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.102096 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.103848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.114343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1299/2589] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:03.142425 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1291/2590] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:02 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:03.146402 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.147986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.161180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40d717-2582-4895-989a-22d3259f7a87 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.220092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.220799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.221087 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.221370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.222058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.224012 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.258115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.258524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.258805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.277378 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:03.287937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.287937 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1292/2591] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:03.301658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.302906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.379552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a13928d-8d01-4650-90af-55398fa5ec26 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.385691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.386530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.387004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.387347 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.392821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1300/2592] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:03 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:03.394417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.398894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.399752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:03.400508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.405234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c723949-5e5f-4024-96fc-65de13fce755 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.410102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.410840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.411602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.411602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.412311 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.414127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.419971 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1293/2593] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:03.428529 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1301/2594] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:03.432537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.449324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933c64d-c055-44da-b9e7-f4fccc8ee432 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.456131 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.456845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.457659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.457949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.458713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.460559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.473413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1294/2595] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:03.477514 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.488712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa48edf-c2a7-4ecc-b335-bbbe44f79fc6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.493534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8fd2c-da17-45d9-929c-76006fac7319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.494455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8fd2c-da17-45d9-929c-76006fac7319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.494748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8fd2c-da17-45d9-929c-76006fac7319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.495294 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8fd2c-da17-45d9-929c-76006fac7319 admin admin] PATH_INFO: `/v3/projects/89f2c4b2ff76487ebce2d42b1fdbd3de/users/5569a3e1588e448fac1b4e2208ce3cb1/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.510457 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8fd2c-da17-45d9-929c-76006fac7319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f2c4b2ff76487ebce2d42b1fdbd3de, user_id=5569a3e1588e448fac1b4e2208ce3cb1, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.513782 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8fd2c-da17-45d9-929c-76006fac7319 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.600164 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.602070 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.615705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a3eb3-25ca-4fd5-98bd-997b36c26305 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.620355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.621363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.621719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.622006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] PATH_INFO: `/v3/projects/d67a4a2adc0349bb896a9e4beff60e7d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.623219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67a4a2adc0349bb896a9e4beff60e7d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.625197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.639395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1302/2596] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:03 2022] PUT /identity/v3/projects/89f2c4b2ff76487ebce2d42b1fdbd3de/users/5569a3e1588e448fac1b4e2208ce3cb1/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:03.649612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.650041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.650324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.657403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:03.678186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] MFA Rules not processed for user `5569a3e1588e448fac1b4e2208ce3cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:03.679373 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.756948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1303/2597] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:03.758288 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.782420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67a4a2adc0349bb896a9e4beff60e7d', 'request_id': 'req-34556f38-dbb5-42a6-b784-1fc161b5e401'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:03.788297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67a4a2adc0349bb896a9e4beff60e7d', 'request_id': 'req-34556f38-dbb5-42a6-b784-1fc161b5e401'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:03.797233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67a4a2adc0349bb896a9e4beff60e7d', 'request_id': 'req-34556f38-dbb5-42a6-b784-1fc161b5e401'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:03.832178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baf267-c357-4c73-93ae-88e86722a306 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.886882 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] The token cache is being invalidate because project d67a4a2adc0349bb896a9e4beff60e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:03.889493 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:03.889614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.889752 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:03.889850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.889850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.889850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.889850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.890243 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1295/2598] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:03 2022] DELETE /identity/v3/projects/d67a4a2adc0349bb896a9e4beff60e7d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:03.893114 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:03.894395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:03.896212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:03.901242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:03.910727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34556f38-dbb5-42a6-b784-1fc161b5e401 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:03.915415 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:03.916282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:03.916564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:03.916877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] PATH_INFO: `/v3/users/fc62e91278364dfa8d6e61145e86cf22` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:03.918110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc62e91278364dfa8d6e61145e86cf22)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:03.920016 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.006734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1304/2599] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:03 2022] POST /identity/v3/projects => generated 385 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:04.010061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.012312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:04.074729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3a6d0-02e9-4f70-9ba2-3cc25fb11d1c admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.079338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.080024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.080307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.080584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.081297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.083182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.148139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc62e91278364dfa8d6e61145e86cf22'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:04.173594 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1305/2600] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:04 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:04.175671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.183333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc62e91278364dfa8d6e61145e86cf22'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:04.183889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc62e91278364dfa8d6e61145e86cf22'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:04.186912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2801a-3baf-496b-b448-be4f55e67e14 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.191909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc62e91278364dfa8d6e61145e86cf22'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:04.192342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.193238 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.193518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.193835 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.195568 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.196501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.207312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1306/2601] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:04.211126 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.213041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:04.225574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb4176-7ac2-4e7d-86ca-5386bc8bf19e admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.230962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.231854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.232174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.232673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] PATH_INFO: `/v3/projects/0d60e781142d448cb5e8342a1ab33510/users/3197804377694942981f3570598ae619/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.250691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d60e781142d448cb5e8342a1ab33510, user_id=3197804377694942981f3570598ae619, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.253408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.293489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc62e91278364dfa8d6e61145e86cf22'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:04.299855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1296/2602] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:03 2022] DELETE /identity/v3/users/fc62e91278364dfa8d6e61145e86cf22 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:04.332372 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1307/2603] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:04 2022] PUT /identity/v3/projects/0d60e781142d448cb5e8342a1ab33510/users/3197804377694942981f3570598ae619/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:04.336364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.403703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e7b0c-7f0f-46e2-8807-a3c3b3bbe708 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.430090 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:04.461280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d71578-6f7e-4eda-8f0e-ed1d67946471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.462000 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71578-6f7e-4eda-8f0e-ed1d67946471 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.462292 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71578-6f7e-4eda-8f0e-ed1d67946471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.462575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d71578-6f7e-4eda-8f0e-ed1d67946471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.463299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d71578-6f7e-4eda-8f0e-ed1d67946471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.465474 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d71578-6f7e-4eda-8f0e-ed1d67946471 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.475262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1297/2604] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:04.480118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.491166 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9c23-8c63-4b31-8a9a-2de02b9fdb1f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.496125 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.497240 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.497659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.497930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] PATH_INFO: `/v3/projects/0d60e781142d448cb5e8342a1ab33510/users/3197804377694942981f3570598ae619/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.500191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d60e781142d448cb5e8342a1ab33510, user_id=3197804377694942981f3570598ae619, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.503249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.515837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1308/2605] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:04 2022] PUT /identity/v3/projects/0d60e781142d448cb5e8342a1ab33510/users/3197804377694942981f3570598ae619/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:04.527132 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.527423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.527700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.557439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] MFA Rules not processed for user `3197804377694942981f3570598ae619`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:04.559057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:04.637911 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1298/2606] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:04.649274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.652482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:04.715145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a560110-59a9-46d9-a2f1-d31b50fdd4ab admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.719381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.720109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.720462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.720833 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.722744 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:04.793168 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:04.806939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.808403 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2daee-64b9-42ff-abbe-41961698a2ec service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:04.817197 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1309/2607] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:04.837567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:04.839959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:04.920277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c36fa3-7758-4a5b-b7d3-f5d2a02e0370 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:04.924874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:04.925759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:04.926007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:04.926280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] PATH_INFO: `/v3/projects/fe5e1708c8c24d07b7660508e32b70fe` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:04.927488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe5e1708c8c24d07b7660508e32b70fe)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:04.929419 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.047519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe5e1708c8c24d07b7660508e32b70fe', 'request_id': 'req-75e07e8c-6875-4bff-9003-32c8a571b052'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:05.049463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:05.053935 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe5e1708c8c24d07b7660508e32b70fe', 'request_id': 'req-75e07e8c-6875-4bff-9003-32c8a571b052'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:05.060509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe5e1708c8c24d07b7660508e32b70fe', 'request_id': 'req-75e07e8c-6875-4bff-9003-32c8a571b052'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:05.144852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] The token cache is being invalidate because project fe5e1708c8c24d07b7660508e32b70fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:05.145147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:05.145778 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-75e07e8c-6875-4bff-9003-32c8a571b052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:05.147421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1299/2608] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:04 2022] DELETE /identity/v3/projects/fe5e1708c8c24d07b7660508e32b70fe => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:05.154109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.154634 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.154762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.174546 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:05.175910 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:05.238734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1310/2609] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:05.248171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.248465 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.248791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.268014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:05.269252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:05.277765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1300/2610] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:05.282056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.296895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965605f-7d3f-4ef6-bcf7-1365b4455965 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.296895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.297541 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.297827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.298104 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.298826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:05.299132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.300742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.313090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1311/2611] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:42:05.317558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.327640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01134b92-ad91-4049-8f74-08314c436b44 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.332468 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.333171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.333449 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.333733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.334409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.336321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.434866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1301/2612] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:05 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:05.439209 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.450052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadb95d-5f60-4633-b716-9d1b62df090a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.516518 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.517216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.517494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.517766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.518460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.520450 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.625466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1312/2613] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:05 2022] POST /identity/v3/users => generated 282 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:05.629877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.640389 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8172784-1eb5-454e-ac3b-c8817435119e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.645061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.652309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.652309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.652309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.652309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.652309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.658842 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1302/2614] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:05.662986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.673789 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3df7c-2ca5-44f0-9979-6481f07294c5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.678505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9266d-9ae9-4ea5-a564-1112d4dc41cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.681056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9266d-9ae9-4ea5-a564-1112d4dc41cf admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.681056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9266d-9ae9-4ea5-a564-1112d4dc41cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.681056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9266d-9ae9-4ea5-a564-1112d4dc41cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.681056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9266d-9ae9-4ea5-a564-1112d4dc41cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.682019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9266d-9ae9-4ea5-a564-1112d4dc41cf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.692407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1313/2615] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:05.697022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.706981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084dbb7d-30be-416f-ba23-cf38330acf55 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.711745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.712632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.712942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.713223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] PATH_INFO: `/v3/projects/984c13f1633146dfa4ad54da35bfc8d2/users/2cb77442892f4e9a8dd34696a9f0e281/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.727747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=984c13f1633146dfa4ad54da35bfc8d2, user_id=2cb77442892f4e9a8dd34696a9f0e281, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.731077 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:05.801413 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1303/2616] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:05 2022] PUT /identity/v3/projects/984c13f1633146dfa4ad54da35bfc8d2/users/2cb77442892f4e9a8dd34696a9f0e281/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:05.812638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.812972 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.813254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.838953 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] MFA Rules not processed for user `2cb77442892f4e9a8dd34696a9f0e281`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:05.840149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:05.881773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:05.906045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1314/2617] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:05.910674 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:05.981525 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cb7c3-cd5f-48a4-b94a-f32b0da83454 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:05.986757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:05.987745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:05.988217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:05.988564 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:05.989400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:05.991536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.114812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1304/2618] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:05 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:06.119959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.131898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecac6b-92d5-4c4e-9964-3edc392433ac None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.190099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.190766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.191057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.191354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.192131 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.194057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.301590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1315/2619] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:06 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:06.305694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.316524 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d937e-5a5b-4d6e-b30e-45b6dd327cd0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.321707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.322366 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.322651 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.323008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.324233 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.325916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.337218 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1305/2620] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:06.341677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.351892 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd488c-8279-46f4-93a9-83c5e945da62 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.358177 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c86b53-f42b-4691-a263-7d4d1037340c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.359013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86b53-f42b-4691-a263-7d4d1037340c admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.359293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86b53-f42b-4691-a263-7d4d1037340c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.359566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86b53-f42b-4691-a263-7d4d1037340c admin admin] PATH_INFO: `/v3/projects/ba9b1c3c0e48479d8a24344e467699c8/users/ff10261e9b1f46b3b7ccc2e8668a1bd3/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.379508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c86b53-f42b-4691-a263-7d4d1037340c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9b1c3c0e48479d8a24344e467699c8, user_id=ff10261e9b1f46b3b7ccc2e8668a1bd3, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.382231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c86b53-f42b-4691-a263-7d4d1037340c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.461446 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1316/2621] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:06 2022] PUT /identity/v3/projects/ba9b1c3c0e48479d8a24344e467699c8/users/ff10261e9b1f46b3b7ccc2e8668a1bd3/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:06.463562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.475323 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21492eab-09de-413b-9a2a-fc50696df1bf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.498868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774038e-028d-4476-ac86-6abe6611cf91 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.499159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774038e-028d-4476-ac86-6abe6611cf91 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.499442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774038e-028d-4476-ac86-6abe6611cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.519551 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-a774038e-028d-4476-ac86-6abe6611cf91 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:06.520877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-a774038e-028d-4476-ac86-6abe6611cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:06.527805 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:06.538955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.539769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.540144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.540523 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.542785 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.545219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.554461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1306/2622] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:06.559255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.569216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db1bf8-b118-4507-a787-635c657d3182 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.575263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.576198 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.581559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.581970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] PATH_INFO: `/v3/projects/ba9b1c3c0e48479d8a24344e467699c8/users/ff10261e9b1f46b3b7ccc2e8668a1bd3/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.585339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba9b1c3c0e48479d8a24344e467699c8, user_id=ff10261e9b1f46b3b7ccc2e8668a1bd3, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.590501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.601528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1317/2623] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:06.605787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1307/2624] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:06 2022] PUT /identity/v3/projects/ba9b1c3c0e48479d8a24344e467699c8/users/ff10261e9b1f46b3b7ccc2e8668a1bd3/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:06.616482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.616681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.616982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.617252 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.618279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:06.645619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] MFA Rules not processed for user `ff10261e9b1f46b3b7ccc2e8668a1bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:06.646863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:06.681154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:06.699495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d3273-565f-4154-80e8-7165b9fbe89c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.705507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.706269 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.706558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.706839 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.721425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1318/2625] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:06.734433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.736034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:06.784313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.786188 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.798211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1308/2626] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:06.803809 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd46f58-fa00-459e-a189-225a6b738b74 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.811954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.811954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.811954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.811954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.819420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:06.819561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.820797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:06.820942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.836944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fae5d1-0f8e-444c-b138-f807d0bc113f service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:06.837083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1319/2627] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:06.838018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:06.838699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:06.839085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:06.839262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:06.841251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:06.912601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:06.914076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:06.927314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1309/2628] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:07.572242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:07.574186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:07.637307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c743-2680-49b4-9dcd-59a36561f6da service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:07.641925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:07.642732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:07.643033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:07.643314 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:07.645135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:07.657943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:07.659368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a487f-f400-4006-8209-033c5c92c192 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:07.670027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1320/2629] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:07.817895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:07.825460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:07.829688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57288740-9293-4321-bb02-e4d5a009e790 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:07.834288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:07.835159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:07.835442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:07.835748 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] PATH_INFO: `/v3/users/2cb77442892f4e9a8dd34696a9f0e281` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:07.836963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb77442892f4e9a8dd34696a9f0e281)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:07.839507 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:08.060656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb77442892f4e9a8dd34696a9f0e281'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:08.080691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb77442892f4e9a8dd34696a9f0e281'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:08.081841 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb77442892f4e9a8dd34696a9f0e281'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:08.090854 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb77442892f4e9a8dd34696a9f0e281'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:08.144354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb77442892f4e9a8dd34696a9f0e281'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:08.155153 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1310/2630] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:07 2022] DELETE /identity/v3/users/2cb77442892f4e9a8dd34696a9f0e281 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:08.158459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:08.158752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:08.159031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:08.178544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:08.180581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:08.249142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1321/2631] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:08.253032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:08.254516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:08.316119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c09828-0a81-4d9f-a742-d2a81b0363a4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:08.320246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:08.321327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:08.321814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:08.322642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:08.342418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:08.343977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:08.354583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1311/2632] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:08.416379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:08.417907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:08.440853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:08.478891 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c5c7-758b-4c77-a861-252163a512d4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:08.482712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:08.483365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:08.483670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:08.483932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:08.485791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:08.553739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:08.558791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:08.575384 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1322/2633] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:08.913513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:08.915217 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:08.929223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616a5a8-7ed5-48c8-9196-e24a7718f408 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:08.935562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:08.936445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:08.936774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:08.937055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] PATH_INFO: `/v3/projects/984c13f1633146dfa4ad54da35bfc8d2` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:08.938314 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=984c13f1633146dfa4ad54da35bfc8d2)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:08.940267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:09.052039 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '984c13f1633146dfa4ad54da35bfc8d2', 'request_id': 'req-ef781c1c-5e77-4098-808b-547fc4e13f1a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.058216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '984c13f1633146dfa4ad54da35bfc8d2', 'request_id': 'req-ef781c1c-5e77-4098-808b-547fc4e13f1a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.065165 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '984c13f1633146dfa4ad54da35bfc8d2', 'request_id': 'req-ef781c1c-5e77-4098-808b-547fc4e13f1a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.186832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] The token cache is being invalidate because project 984c13f1633146dfa4ad54da35bfc8d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:09.187163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.187788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.189396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1312/2634] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:08 2022] DELETE /identity/v3/projects/984c13f1633146dfa4ad54da35bfc8d2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:09.193566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:09.204942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9b2da-8193-4c1e-af28-1036979981b6 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:09.263068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:09.263971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:09.264256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:09.264528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] PATH_INFO: `/v3/users/ff10261e9b1f46b3b7ccc2e8668a1bd3` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:09.265768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff10261e9b1f46b3b7ccc2e8668a1bd3)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:09.267736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:09.496287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff10261e9b1f46b3b7ccc2e8668a1bd3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.497226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff10261e9b1f46b3b7ccc2e8668a1bd3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.586938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff10261e9b1f46b3b7ccc2e8668a1bd3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.593414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff10261e9b1f46b3b7ccc2e8668a1bd3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.594195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-371137b3-3ba5-4d43-b318-c3b7e11ec02e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff10261e9b1f46b3b7ccc2e8668a1bd3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:09.601477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:09.616808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1323/2635] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:09 2022] DELETE /identity/v3/users/ff10261e9b1f46b3b7ccc2e8668a1bd3 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:10.112975 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:10.115081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:10.141005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:10.146698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef781c1c-5e77-4098-808b-547fc4e13f1a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:10.218277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:10.219157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:10.219443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:10.219870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] PATH_INFO: `/v3/projects/ba9b1c3c0e48479d8a24344e467699c8` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:10.221208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba9b1c3c0e48479d8a24344e467699c8)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:10.223130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:10.341511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba9b1c3c0e48479d8a24344e467699c8', 'request_id': 'req-a18fcf9b-e961-4b29-a6ce-55964f0733a6'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:10.351552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba9b1c3c0e48479d8a24344e467699c8', 'request_id': 'req-a18fcf9b-e961-4b29-a6ce-55964f0733a6'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:10.356251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba9b1c3c0e48479d8a24344e467699c8', 'request_id': 'req-a18fcf9b-e961-4b29-a6ce-55964f0733a6'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:10.433831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] The token cache is being invalidate because project ba9b1c3c0e48479d8a24344e467699c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:10.434175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:10.434858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-a18fcf9b-e961-4b29-a6ce-55964f0733a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:10.437400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1313/2636] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:10 2022] DELETE /identity/v3/projects/ba9b1c3c0e48479d8a24344e467699c8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:10.442564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:10.443073 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:10.443453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:10.463708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:10.466432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:10.527582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1324/2637] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:10.544697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:10.544697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:10.544697 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:10.584458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:10.587255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:10.604834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1314/2638] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:10.605256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:10.631994 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66d200-23ac-469d-81bb-8b00ee9136b4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:10.633326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:10.634481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:10.634832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:10.635973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:10.636929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:10.637409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:10.639737 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:10.657954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1325/2639] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:42:10.659015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:10.674008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577197e-7c8a-40c4-999c-4e8b5fdf3ddc None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:10.679151 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:10.679897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:10.680241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:10.680646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:10.681395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:10.684303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:10.793732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1315/2640] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:10 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:10.797815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:10.810029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c8614f-a823-4f80-9390-bf0deeb33025 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:10.911970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:10.912763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:10.913055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:10.913338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:10.915689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:10.920124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.037044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1326/2641] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:10 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:11.038066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.050194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eacecd-4695-416c-aed9-e311e21be715 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.058863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.059794 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.060386 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.060690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.061654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.063845 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.076094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1316/2642] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:11.085404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.096383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bbb7-9c0a-4636-870d-24edc0dc77c0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.101367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62588ef-bf28-40e7-9f12-f504ea755df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.102167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62588ef-bf28-40e7-9f12-f504ea755df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.102447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62588ef-bf28-40e7-9f12-f504ea755df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.102722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62588ef-bf28-40e7-9f12-f504ea755df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.103454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62588ef-bf28-40e7-9f12-f504ea755df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.105950 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62588ef-bf28-40e7-9f12-f504ea755df1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.124932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1327/2643] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:11.125641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.138749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d94682-56cc-4478-a44c-0effc8601421 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.145066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.146203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.146562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.146972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] PATH_INFO: `/v3/projects/cabc9c8e38e04e86ae8832d3182b36fe/users/46a3c2083b12478fbbc05c2665060007/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.164022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabc9c8e38e04e86ae8832d3182b36fe, user_id=46a3c2083b12478fbbc05c2665060007, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.167597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.266097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1317/2644] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:11 2022] PUT /identity/v3/projects/cabc9c8e38e04e86ae8832d3182b36fe/users/46a3c2083b12478fbbc05c2665060007/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:11.277513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.278246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.279808 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.340184 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] MFA Rules not processed for user `46a3c2083b12478fbbc05c2665060007`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:11.341515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:11.386326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:11.409982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1328/2645] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:11.414627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.482048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:11.522510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09607152-cf8a-467e-b972-35caf3ac56a1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.527821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.528382 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.528694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.528974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.533250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.535279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.589441 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.590870 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:11.610824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2bf940-728b-4a30-9a29-b9c9574cd4ee None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.617154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.618127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.618488 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.618826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] PATH_INFO: `/v3/users/3edd15e5a774477d91c721251e61f5fd` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.620138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3edd15e5a774477d91c721251e61f5fd)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.622141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.632579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1318/2646] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:11 2022] POST /identity/v3/projects => generated 377 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:11.637403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.714471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca80840-df1f-47fe-8898-4a47b4e663f5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.719484 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.720320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.720714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.721095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.721871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.723924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.805880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1319/2647] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:11 2022] POST /identity/v3/users => generated 295 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:11.809824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.819142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aabe0-20f9-4fd6-81e1-9b242efcf1cc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.824439 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.825107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.825387 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.825663 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.826395 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.827953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.837500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1320/2648] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:11.847446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.856639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b94686-a988-48b9-8cee-3907842422bc admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:11.861163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:11.862260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:11.862260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:11.862640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] PATH_INFO: `/v3/projects/c4c4287b9d1c41a38a348366f4bca65b/users/74eb5e85054f412fbafb868fa976ca25/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:11.879428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c4287b9d1c41a38a348366f4bca65b, user_id=74eb5e85054f412fbafb868fa976ca25, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:11.882021 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:11.907466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3edd15e5a774477d91c721251e61f5fd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:11.912052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3edd15e5a774477d91c721251e61f5fd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:11.972834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1321/2649] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:11 2022] PUT /identity/v3/projects/c4c4287b9d1c41a38a348366f4bca65b/users/74eb5e85054f412fbafb868fa976ca25/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:11.979117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:11.995947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3edd15e5a774477d91c721251e61f5fd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.004408 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3edd15e5a774477d91c721251e61f5fd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.005142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3edd15e5a774477d91c721251e61f5fd'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.023148 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1329/2650] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:11 2022] DELETE /identity/v3/users/3edd15e5a774477d91c721251e61f5fd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:12.041099 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e509cd-96c1-40e1-b8bf-7d9813403cde admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.104900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb2284-90a3-47b3-8bc4-020a8bc731db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.105556 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb2284-90a3-47b3-8bc4-020a8bc731db admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.106299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb2284-90a3-47b3-8bc4-020a8bc731db admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.107102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb2284-90a3-47b3-8bc4-020a8bc731db admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.107932 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb2284-90a3-47b3-8bc4-020a8bc731db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.109598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb2284-90a3-47b3-8bc4-020a8bc731db admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:12.122705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1322/2651] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:12.126688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:12.128072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.143582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed2324-69f2-4e5b-8ad1-114d60bbc769 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.150081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.150081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.150081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.150081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] PATH_INFO: `/v3/projects/c4c4287b9d1c41a38a348366f4bca65b/users/74eb5e85054f412fbafb868fa976ca25/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.151879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c4287b9d1c41a38a348366f4bca65b, user_id=74eb5e85054f412fbafb868fa976ca25, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.154531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:12.168469 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1330/2652] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:12 2022] PUT /identity/v3/projects/c4c4287b9d1c41a38a348366f4bca65b/users/74eb5e85054f412fbafb868fa976ca25/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:12.176746 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.177582 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.177865 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.205363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] MFA Rules not processed for user `74eb5e85054f412fbafb868fa976ca25`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:12.206528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.273515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1323/2653] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:12.284736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:12.286395 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.291912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:12.293506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.364339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d5365-4f47-4efd-822f-d52f907bc24d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.369391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.370829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.371110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.371381 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] PATH_INFO: `/v3/projects/688ce67475ff471faccdbdce847b5aa5` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.372574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688ce67475ff471faccdbdce847b5aa5)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.374592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:12.377193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad5d84-3b57-4286-b649-8a254f2f1ed9 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.381299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.381552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.381828 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.382098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.383956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.423912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:12.441999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:12.444203 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.445679 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee8bea-05c6-419f-ac99-dbc569d9fe64 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:12.455279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1331/2654] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:12.485091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688ce67475ff471faccdbdce847b5aa5', 'request_id': 'req-5d607715-a530-4bdf-a3ac-2b96b378b431'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.490834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688ce67475ff471faccdbdce847b5aa5', 'request_id': 'req-5d607715-a530-4bdf-a3ac-2b96b378b431'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.498843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688ce67475ff471faccdbdce847b5aa5', 'request_id': 'req-5d607715-a530-4bdf-a3ac-2b96b378b431'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.598412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] The token cache is being invalidate because project 688ce67475ff471faccdbdce847b5aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:12.598699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.599327 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5d607715-a530-4bdf-a3ac-2b96b378b431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:12.600919 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1324/2655] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:12 2022] DELETE /identity/v3/projects/688ce67475ff471faccdbdce847b5aa5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:12.606409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.606699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.606976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.625280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:12.626500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.686722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1332/2656] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:12.694334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.694629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.694909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.714174 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:12.715375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:12.723330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1325/2657] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:12.727369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:12.737632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f5a31-7eaa-411a-b0a7-c78602a841d4 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.742590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.743247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.743531 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.743807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.744537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:12.744880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.746515 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:12.761604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1333/2658] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:42:12.768369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:12.768369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:12.772959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d0ba3-8dc4-46f8-a296-e3838da5223d None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.777820 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.778552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.778924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.779267 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.780038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.782049 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:12.924004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1326/2659] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:12 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:12.927098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:12.937142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b9c5-8670-4429-a938-da352c33c88a admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:12.992553 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:12.993287 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:12.993569 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:12.993845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:12.994561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:12.996483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.092922 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1334/2660] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:12 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:13.097139 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.107277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3c57e-e25d-4daa-9ab5-dc5aefe7660d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.111900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.112552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.112880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.113161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.113910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.115495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.125411 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1327/2661] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:13.129345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.139700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81514b4-2eea-4e56-a1cc-b53597462bb7 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.145179 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c89b33-4f9e-49c7-ab40-2e8cc02f6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.145868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89b33-4f9e-49c7-ab40-2e8cc02f6144 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.146153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89b33-4f9e-49c7-ab40-2e8cc02f6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.146458 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c89b33-4f9e-49c7-ab40-2e8cc02f6144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.147219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89b33-4f9e-49c7-ab40-2e8cc02f6144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.148838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c89b33-4f9e-49c7-ab40-2e8cc02f6144 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.159790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1335/2662] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:13.163984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.174281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2f231-5889-4c33-b6a7-05c550cfb92c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.178970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.179858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.180297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.180490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] PATH_INFO: `/v3/projects/b88eaa361cd14cfba36328d1d154a1ce/users/e465897b74dd41e285995e15e24bc4d3/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.202976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88eaa361cd14cfba36328d1d154a1ce, user_id=e465897b74dd41e285995e15e24bc4d3, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.205812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.280550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1328/2663] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:13 2022] PUT /identity/v3/projects/b88eaa361cd14cfba36328d1d154a1ce/users/e465897b74dd41e285995e15e24bc4d3/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:13.291439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a610e-0281-4898-b819-79c28ea66497 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.291730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a610e-0281-4898-b819-79c28ea66497 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.292013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a610e-0281-4898-b819-79c28ea66497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.319266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-456a610e-0281-4898-b819-79c28ea66497 None None] MFA Rules not processed for user `e465897b74dd41e285995e15e24bc4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:13.320495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-456a610e-0281-4898-b819-79c28ea66497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:13.368235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:13.384759 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1336/2664] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:13.394938 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.439990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a610e-0281-4898-b819-79c28ea66497 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.441753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-456a610e-0281-4898-b819-79c28ea66497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:13.464423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e5541-a6c4-4200-aadb-745f8eedab28 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.469038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.469689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.470011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.470285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.470970 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.472893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.506349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a610e-0281-4898-b819-79c28ea66497 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.511624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.512659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.512948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.513226 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] PATH_INFO: `/v3/users/dc3a1618766e421bb46c723fe6304531` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.514448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3a1618766e421bb46c723fe6304531)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.516353 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.577719 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1329/2665] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:13 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:13.581702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.629994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:13.643105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03c4c7-b7e9-4cc0-b273-b367e2790f72 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.647710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.648367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.648679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.648959 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.649670 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.651565 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.692074 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3a1618766e421bb46c723fe6304531'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:13.692901 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3a1618766e421bb46c723fe6304531'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:13.761604 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1330/2666] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:13 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:13.765676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.774968 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7598b-cfe3-4ceb-917d-5f8d781efd6b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.779603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.780232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.780520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.780828 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.781546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.783149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.783778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3a1618766e421bb46c723fe6304531'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:13.791817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3a1618766e421bb46c723fe6304531'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:13.792468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-37ecee37-a00c-40b0-a576-b45b243a3d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3a1618766e421bb46c723fe6304531'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:13.794734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1331/2667] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:13.798757 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.800400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:13.813112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755abfc-c5f8-4579-9119-1066c7800090 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.814669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1337/2668] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:13 2022] DELETE /identity/v3/users/dc3a1618766e421bb46c723fe6304531 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:13.819284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.819571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.819851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.837442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:13.838874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:13.870057 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.871079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.871358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.871636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] PATH_INFO: `/v3/projects/892a5a80da254e2baebbb04480405cef/users/109df6dca1b54d10b6857812ec9db94b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.887332 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] RBAC: Authorizing `identity:create_grant(project_id=892a5a80da254e2baebbb04480405cef, user_id=109df6dca1b54d10b6857812ec9db94b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.890478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.900342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1338/2669] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:13.909742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.911204 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:13.924416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:13.969118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd9a4f-c92a-44d2-aa9f-505ef4de3c77 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:13.972743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:13.973393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:13.973676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:13.973960 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:13.985467 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:13.987065 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:13.990136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1332/2670] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:13 2022] PUT /identity/v3/projects/892a5a80da254e2baebbb04480405cef/users/109df6dca1b54d10b6857812ec9db94b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:13.993863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:13.999827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1339/2671] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:14.065343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34b641-59f2-4115-8602-7a6f6640949d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.070561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48288ef1-7b32-447b-b940-ac10c7a55c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.071652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288ef1-7b32-447b-b940-ac10c7a55c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.072102 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288ef1-7b32-447b-b940-ac10c7a55c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.072662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48288ef1-7b32-447b-b940-ac10c7a55c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.073546 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288ef1-7b32-447b-b940-ac10c7a55c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.075232 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48288ef1-7b32-447b-b940-ac10c7a55c9a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:14.089836 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1333/2672] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:14.091041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:14.103315 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c16d0-252c-4b7d-9711-659d23c3cd12 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.108887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.109769 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.110103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.110400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] PATH_INFO: `/v3/projects/892a5a80da254e2baebbb04480405cef/users/109df6dca1b54d10b6857812ec9db94b/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.112397 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=892a5a80da254e2baebbb04480405cef, user_id=109df6dca1b54d10b6857812ec9db94b, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.115042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:14.126015 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1340/2673] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:14 2022] PUT /identity/v3/projects/892a5a80da254e2baebbb04480405cef/users/109df6dca1b54d10b6857812ec9db94b/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:14.136063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992b68-026f-439a-a210-657447fa98dd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.136355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992b68-026f-439a-a210-657447fa98dd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.136933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992b68-026f-439a-a210-657447fa98dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.162884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-c6992b68-026f-439a-a210-657447fa98dd None None] MFA Rules not processed for user `109df6dca1b54d10b6857812ec9db94b`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:14.164108 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c6992b68-026f-439a-a210-657447fa98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:14.199254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:14.238498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1334/2674] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:14.251596 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:14.253415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:14.305307 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992b68-026f-439a-a210-657447fa98dd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:14.308134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c6992b68-026f-439a-a210-657447fa98dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:14.323241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237a0f0-4ad6-48df-b210-204fde4f18ad admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.330176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.330998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.331387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.331903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.342317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.343878 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:14.355219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1341/2675] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:14.370262 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992b68-026f-439a-a210-657447fa98dd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.374223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.374874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.375160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.375438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.377277 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:14.438568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.440240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:14.449681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:14.450922 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1335/2676] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:14.456016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:14.558194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf4b59-9cfe-4351-9b5b-dbe5befcbd2e service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.559808 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:14.563290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.564152 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.564431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.564740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] PATH_INFO: `/v3/projects/060a814c02114fae81295637f7bd8172` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.566070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060a814c02114fae81295637f7bd8172)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.567943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:14.568575 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb2cc7-6554-497b-b237-2f024c226e42 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.572784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.573421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.573705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.573978 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.575823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:14.635855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.637337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:14.646807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1336/2677] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:14.699623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:14.702120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060a814c02114fae81295637f7bd8172', 'request_id': 'req-7017cbd8-c599-446d-814e-32caf11628d3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:14.708221 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060a814c02114fae81295637f7bd8172', 'request_id': 'req-7017cbd8-c599-446d-814e-32caf11628d3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:14.771887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060a814c02114fae81295637f7bd8172', 'request_id': 'req-7017cbd8-c599-446d-814e-32caf11628d3'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:14.782771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] The token cache is being invalidate because project 060a814c02114fae81295637f7bd8172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:14.783058 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:14.783685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:14.785264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1342/2678] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:14 2022] DELETE /identity/v3/projects/060a814c02114fae81295637f7bd8172 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:14.789176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:14.800326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eaa67e-d6e1-4628-93d0-789cf5e3cad2 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:14.817509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:14.857807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:14.858679 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:14.858964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:14.859281 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] PATH_INFO: `/v3/users/5569a3e1588e448fac1b4e2208ce3cb1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:14.860487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5569a3e1588e448fac1b4e2208ce3cb1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:14.862562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:15.046017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5569a3e1588e448fac1b4e2208ce3cb1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.057907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5569a3e1588e448fac1b4e2208ce3cb1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.058573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5569a3e1588e448fac1b4e2208ce3cb1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.066258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5569a3e1588e448fac1b4e2208ce3cb1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.140684 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5569a3e1588e448fac1b4e2208ce3cb1'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.147253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1337/2679] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:14 2022] DELETE /identity/v3/users/5569a3e1588e448fac1b4e2208ce3cb1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:15.548045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:15.549588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:15.564757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017cbd8-c599-446d-814e-32caf11628d3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:15.623366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:15.624242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:15.624524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:15.624830 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] PATH_INFO: `/v3/projects/89f2c4b2ff76487ebce2d42b1fdbd3de` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:15.626186 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f2c4b2ff76487ebce2d42b1fdbd3de)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:15.628116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:15.727482 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f2c4b2ff76487ebce2d42b1fdbd3de', 'request_id': 'req-65b1fd44-ead6-48f7-93c0-079c39229739'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.734172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f2c4b2ff76487ebce2d42b1fdbd3de', 'request_id': 'req-65b1fd44-ead6-48f7-93c0-079c39229739'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.829193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f2c4b2ff76487ebce2d42b1fdbd3de', 'request_id': 'req-65b1fd44-ead6-48f7-93c0-079c39229739'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.840829 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] The token cache is being invalidate because project 89f2c4b2ff76487ebce2d42b1fdbd3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:15.841138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.841864 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:15.843625 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1343/2680] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:15 2022] DELETE /identity/v3/projects/89f2c4b2ff76487ebce2d42b1fdbd3de => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:15.847503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:15.848923 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:15.862784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85c4c-ad45-49f6-806b-51f16542329a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:15.920404 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:15.921316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:15.921601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:15.921877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] PATH_INFO: `/v3/users/3197804377694942981f3570598ae619` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:15.923086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3197804377694942981f3570598ae619)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:15.925086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:16.169114 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:16.174705 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3197804377694942981f3570598ae619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:16.188601 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3197804377694942981f3570598ae619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:16.190009 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3197804377694942981f3570598ae619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:16.197503 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3197804377694942981f3570598ae619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:16.333119 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-557a0d36-0b6a-4024-bdbe-3643d52736fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3197804377694942981f3570598ae619'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:16.340742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1338/2681] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:15 2022] DELETE /identity/v3/users/3197804377694942981f3570598ae619 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:16.859942 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:16.862591 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:16.878912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1fd44-ead6-48f7-93c0-079c39229739 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:16.943678 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:16.944646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:16.948877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:16.948877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] PATH_INFO: `/v3/projects/0d60e781142d448cb5e8342a1ab33510` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:16.948877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d60e781142d448cb5e8342a1ab33510)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:16.949725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:16.956075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:17.057070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d60e781142d448cb5e8342a1ab33510', 'request_id': 'req-3c83f880-0c29-4199-867e-eada481f15b6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:17.062963 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d60e781142d448cb5e8342a1ab33510', 'request_id': 'req-3c83f880-0c29-4199-867e-eada481f15b6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:17.143327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d60e781142d448cb5e8342a1ab33510', 'request_id': 'req-3c83f880-0c29-4199-867e-eada481f15b6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:17.154690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] The token cache is being invalidate because project 0d60e781142d448cb5e8342a1ab33510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:17.154981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:17.155685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3c83f880-0c29-4199-867e-eada481f15b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:17.157327 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1344/2682] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:16 2022] DELETE /identity/v3/projects/0d60e781142d448cb5e8342a1ab33510 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:17.162320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.162811 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.162910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.182290 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:17.183489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:17.241862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1339/2683] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:17.250009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.250303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.250607 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.269496 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:17.270697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:17.279797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1345/2684] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:17.284096 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:17.293605 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45fd5f-22a7-4584-8eac-0352c40ce8d1 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:17.298225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:17.298871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.299301 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.299483 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.300209 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:17.300536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:17.302181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:17.317528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1340/2685] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:42:17.318673 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:17.328905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd4c82-9213-4fe9-8f34-ffdcf9fdba61 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:17.334387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:17.338510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.338510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.338510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.338510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:17.338871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:17.478054 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1346/2686] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:17 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:17.479237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:17.489812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52dcd1-c14f-444c-9c28-2d77474444a5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:17.549856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:17.550539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.550884 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.551163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.552348 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:17.553782 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:17.658045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1341/2687] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:17 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:17.662630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:17.672856 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475115e-4ac3-492b-b538-57aaa773a177 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:17.677504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:17.678149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.678429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.678700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.679640 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:17.681277 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:17.692604 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1347/2688] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:17.696846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:17.707358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fc224-80c9-465e-9fda-a7d0a796286e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:17.715254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92c240-1e69-4ff4-9da5-8f138c024742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:17.733681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c240-1e69-4ff4-9da5-8f138c024742 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.733681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c240-1e69-4ff4-9da5-8f138c024742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.733681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92c240-1e69-4ff4-9da5-8f138c024742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.733681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92c240-1e69-4ff4-9da5-8f138c024742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:17.733681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92c240-1e69-4ff4-9da5-8f138c024742 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:17.733681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1342/2689] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:17.738484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:17.749726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53150042-d8fb-4545-87d2-368d58e7f9cf admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:17.755366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:17.755961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.756312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.756689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] PATH_INFO: `/v3/projects/5f28eebfe12849a18866054101c4aa9f/users/9263dac930b747da8fbaddfcfe404884/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.774763 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f28eebfe12849a18866054101c4aa9f, user_id=9263dac930b747da8fbaddfcfe404884, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:17.777686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:17.875951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1348/2690] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:17 2022] PUT /identity/v3/projects/5f28eebfe12849a18866054101c4aa9f/users/9263dac930b747da8fbaddfcfe404884/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:17.945571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:17.946045 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:17.946296 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:17.972866 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] MFA Rules not processed for user `9263dac930b747da8fbaddfcfe404884`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:17.974319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:17.986898 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:18.040494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1343/2691] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:17 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:18.099841 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:18.101697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:18.167530 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152184c8-a1bd-479d-8a1c-937e3384d789 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:18.173928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf700c87-cc54-4a06-b507-4a9ec14602a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:18.174709 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf700c87-cc54-4a06-b507-4a9ec14602a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:18.174999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf700c87-cc54-4a06-b507-4a9ec14602a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:18.175334 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf700c87-cc54-4a06-b507-4a9ec14602a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:18.185091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf700c87-cc54-4a06-b507-4a9ec14602a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:18.186571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf700c87-cc54-4a06-b507-4a9ec14602a5 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:18.195387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1349/2692] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:18.284928 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:18.286491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:18.352022 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ac91c-dc9a-4bdd-b522-c3d2482aa242 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:18.357133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:18.358002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:18.358285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:18.358561 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] PATH_INFO: `/v3/users/e465897b74dd41e285995e15e24bc4d3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:18.360061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e465897b74dd41e285995e15e24bc4d3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:18.362846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:18.537443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e465897b74dd41e285995e15e24bc4d3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:18.550772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e465897b74dd41e285995e15e24bc4d3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:18.551541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e465897b74dd41e285995e15e24bc4d3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:18.561747 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e465897b74dd41e285995e15e24bc4d3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:18.649452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e465897b74dd41e285995e15e24bc4d3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:18.656542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1344/2693] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:18 2022] DELETE /identity/v3/users/e465897b74dd41e285995e15e24bc4d3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:18.661072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:18.661367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:18.661646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:18.680149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:18.681409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:18.710029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:18.739796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1350/2694] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:18.750012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:18.751431 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:18.794088 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:18.815619 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af2a27-1e8a-42cc-ae76-6570899408c2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:18.819264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:18.820026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:18.820177 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:18.820455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:18.831135 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:18.832560 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:18.842848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:18.842992 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1345/2695] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:18.844392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:18.856069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f4112-b252-4b00-8944-82554e233ec1 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:18.860951 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:18.861948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:18.862234 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:18.862633 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] PATH_INFO: `/v3/users/46a3c2083b12478fbbc05c2665060007` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:18.863894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46a3c2083b12478fbbc05c2665060007)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:18.865883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:19.108159 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46a3c2083b12478fbbc05c2665060007'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.109682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46a3c2083b12478fbbc05c2665060007'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.223063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46a3c2083b12478fbbc05c2665060007'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.233802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46a3c2083b12478fbbc05c2665060007'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.233802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-e4349d76-23d0-4ea4-84b1-386d760da545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46a3c2083b12478fbbc05c2665060007'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.247103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:19.248597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:19.257424 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1351/2696] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:18 2022] DELETE /identity/v3/users/46a3c2083b12478fbbc05c2665060007 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:19.265172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:19.265468 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:19.265773 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:19.275180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378aab4f-e3b7-493d-b4da-df774db7875d service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:19.288268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:19.289511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:19.337159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:19.338357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:19.338710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:19.339061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] PATH_INFO: `/v3/projects/b88eaa361cd14cfba36328d1d154a1ce` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:19.340358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88eaa361cd14cfba36328d1d154a1ce)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:19.342505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:19.363417 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1352/2697] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:19.369713 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:19.371247 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:19.424739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:19.429725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d793140-8b55-4150-8003-b2d9d9df7347 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:19.434881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:19.435524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:19.435805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:19.436075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:19.445227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:19.446932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:19.450367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88eaa361cd14cfba36328d1d154a1ce', 'request_id': 'req-acdd1fa6-3e64-4143-87e2-ed909e84194b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.456184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88eaa361cd14cfba36328d1d154a1ce', 'request_id': 'req-acdd1fa6-3e64-4143-87e2-ed909e84194b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.457501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1353/2698] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:19.462913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88eaa361cd14cfba36328d1d154a1ce', 'request_id': 'req-acdd1fa6-3e64-4143-87e2-ed909e84194b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.600200 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] The token cache is being invalidate because project b88eaa361cd14cfba36328d1d154a1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:19.600497 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.601162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.602707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1346/2699] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:19 2022] DELETE /identity/v3/projects/b88eaa361cd14cfba36328d1d154a1ce => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:19.607506 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:19.608912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:19.622548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeac826-637a-4d85-be17-5ac6bb1fc567 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:19.684642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:19.685524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:19.685802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:19.686072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] PATH_INFO: `/v3/users/109df6dca1b54d10b6857812ec9db94b` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:19.687281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] RBAC: Authorizing `identity:delete_user(user_id=109df6dca1b54d10b6857812ec9db94b)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:19.689232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:19.909559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109df6dca1b54d10b6857812ec9db94b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:19.910259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109df6dca1b54d10b6857812ec9db94b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.009590 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109df6dca1b54d10b6857812ec9db94b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.017036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109df6dca1b54d10b6857812ec9db94b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.017685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109df6dca1b54d10b6857812ec9db94b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.034981 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1354/2700] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:19 2022] DELETE /identity/v3/users/109df6dca1b54d10b6857812ec9db94b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:20.087207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:20.088976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:20.104737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd1fa6-3e64-4143-87e2-ed909e84194b admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:20.166448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:20.167305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:20.167588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:20.167863 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] PATH_INFO: `/v3/projects/cabc9c8e38e04e86ae8832d3182b36fe` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:20.169083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabc9c8e38e04e86ae8832d3182b36fe)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:20.170972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:20.179082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:20.313846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabc9c8e38e04e86ae8832d3182b36fe', 'request_id': 'req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.321640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabc9c8e38e04e86ae8832d3182b36fe', 'request_id': 'req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.328974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabc9c8e38e04e86ae8832d3182b36fe', 'request_id': 'req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.399788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] The token cache is being invalidate because project cabc9c8e38e04e86ae8832d3182b36fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:20.401535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.401856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.403737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1347/2701] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:20 2022] DELETE /identity/v3/projects/cabc9c8e38e04e86ae8832d3182b36fe => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:20.407890 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:20.409407 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:20.422258 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c14dae-20b4-439d-8f82-4fca9112606f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:20.477051 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:20.477914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:20.478198 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:20.478512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] PATH_INFO: `/v3/users/74eb5e85054f412fbafb868fa976ca25` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:20.479686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74eb5e85054f412fbafb868fa976ca25)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:20.481612 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:20.491699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:20.503097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:20.504933 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:20.521824 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d95561-e2c9-4fb3-92b1-f44a706e1ebf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:20.531447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:20.532390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:20.532606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:20.532993 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] PATH_INFO: `/v3/projects/892a5a80da254e2baebbb04480405cef` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:20.534288 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=892a5a80da254e2baebbb04480405cef)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:20.536303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:20.668854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74eb5e85054f412fbafb868fa976ca25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.669660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892a5a80da254e2baebbb04480405cef', 'request_id': 'req-f1902f19-a7ef-47b2-889f-1b02fd293f4f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.669949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74eb5e85054f412fbafb868fa976ca25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.675513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892a5a80da254e2baebbb04480405cef', 'request_id': 'req-f1902f19-a7ef-47b2-889f-1b02fd293f4f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.682644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892a5a80da254e2baebbb04480405cef', 'request_id': 'req-f1902f19-a7ef-47b2-889f-1b02fd293f4f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.740501 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74eb5e85054f412fbafb868fa976ca25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.748565 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74eb5e85054f412fbafb868fa976ca25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.749235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-3b9b2fdf-81b0-4644-88d1-a040740df29c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74eb5e85054f412fbafb868fa976ca25'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.766805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1355/2702] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:20 2022] DELETE /identity/v3/users/74eb5e85054f412fbafb868fa976ca25 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:20.896405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] The token cache is being invalidate because project 892a5a80da254e2baebbb04480405cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:20.896571 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.897326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f1902f19-a7ef-47b2-889f-1b02fd293f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:20.903031 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1348/2703] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:20 2022] DELETE /identity/v3/projects/892a5a80da254e2baebbb04480405cef => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:20.907653 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:20.908006 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:20.908443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:20.927149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:20.928359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:20.995165 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1356/2704] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:21.002758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.003333 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.003614 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.024698 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:21.026208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:21.034447 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1349/2705] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:21.038728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.049913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f61f739-2280-4921-af61-051667f8cb90 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.054696 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.055404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.055692 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.055968 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.057379 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:21.057686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.059312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.076573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1357/2706] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:42:21.076732 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.084994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8ef01-d484-4c62-9de4-c447b6f1da39 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.090156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.090887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.091172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.091445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.092179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.094105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.202298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1350/2707] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:21.207473 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.217361 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c89f5-65de-4c70-8783-4b4fc559f108 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.235107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.249766 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:21.277848 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.278539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.278967 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.279253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.279992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.282002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.311015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:21.325255 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79329793-03f6-4852-9976-d06cf14442ad admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.330183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.331043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.331326 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.331599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] PATH_INFO: `/v3/projects/c4c4287b9d1c41a38a348366f4bca65b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.332819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c4287b9d1c41a38a348366f4bca65b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.334763 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.415380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1358/2708] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/users => generated 284 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:21.419887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.426085 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:21.429768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680a64-c092-4f2d-85b4-475772c01e70 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.434455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.435237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.435525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.435826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.436608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.438544 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.449779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1359/2709] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:21.453646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.459418 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c4287b9d1c41a38a348366f4bca65b', 'request_id': 'req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:21.463814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f8ac6-199e-476f-8206-e58365408c80 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.465585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c4287b9d1c41a38a348366f4bca65b', 'request_id': 'req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:21.473097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c4287b9d1c41a38a348366f4bca65b', 'request_id': 'req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:21.520200 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.520887 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.521248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.522206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.522325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.523895 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.539712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1360/2710] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:21.548863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.549030 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] The token cache is being invalidate because project c4c4287b9d1c41a38a348366f4bca65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:21.549334 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:21.549963 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-876f5da0-eb79-4fe5-afd2-b66c5fbf152c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:21.551521 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1351/2711] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:21 2022] DELETE /identity/v3/projects/c4c4287b9d1c41a38a348366f4bca65b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:21.558976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ff0bc-b184-49fe-86d0-64498f51c9f0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.559169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5084d7-8411-4bb1-97ce-7efac79969da None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.559448 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5084d7-8411-4bb1-97ce-7efac79969da None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.559823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5084d7-8411-4bb1-97ce-7efac79969da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.563742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa273858-d1ca-4ec5-a81d-94fc3387dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.567219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273858-d1ca-4ec5-a81d-94fc3387dacc admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.567219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273858-d1ca-4ec5-a81d-94fc3387dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.567219 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa273858-d1ca-4ec5-a81d-94fc3387dacc admin admin] PATH_INFO: `/v3/projects/12664ab163ae4b3da80a436b2e781544/users/fe5d8be646bb499a94e3212c59a58ccb/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.579159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6c5084d7-8411-4bb1-97ce-7efac79969da None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:21.580517 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6c5084d7-8411-4bb1-97ce-7efac79969da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:21.581459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa273858-d1ca-4ec5-a81d-94fc3387dacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=12664ab163ae4b3da80a436b2e781544, user_id=fe5d8be646bb499a94e3212c59a58ccb, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.584248 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa273858-d1ca-4ec5-a81d-94fc3387dacc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.589321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1352/2712] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:21.596957 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.597254 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.597528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.615557 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:21.616888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:21.624749 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1353/2713] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:21.628727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.637466 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca4167-0894-43e6-be2d-f3c8aa90abbd None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.641986 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.642593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.642878 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.647795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.647795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:21.647795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.647795 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.658887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1354/2714] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:42:21.661774 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.676231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a65a4-786d-49a3-8310-3942ba27d2ba admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.676383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1361/2715] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:21 2022] PUT /identity/v3/projects/12664ab163ae4b3da80a436b2e781544/users/fe5d8be646bb499a94e3212c59a58ccb/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:21.686273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.686566 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.686850 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.713573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] MFA Rules not processed for user `fe5d8be646bb499a94e3212c59a58ccb`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:21.714783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:21.728722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.729396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.729680 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.729955 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.730833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.732729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.778956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1362/2716] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:21.783405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.784745 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:21.797505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60715f76-1e92-474e-9b2f-43044e38dd9d None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.802167 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.802812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.803097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.803382 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.804070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.805970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.836078 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1355/2717] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:21.840830 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.899461 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88787f-b4d8-410d-b515-4b8b7da62a1d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.904897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.905590 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.905877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.906157 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.906846 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.909036 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:21.925031 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1363/2718] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:21.926062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:21.987039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adcc67-5f31-4c39-aefb-336ab9ae25f8 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:21.991749 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:21.992411 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:21.992722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:21.992999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:21.993816 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:21.995706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.028226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1356/2719] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:22.033442 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.043526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ede83-5cc2-4d7b-8f23-68edabf19141 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.048294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.048973 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.049258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.049532 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.050259 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.051859 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.061678 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1357/2720] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:22.065541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.075591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57437625-c32d-429b-aedc-4067434af239 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.080162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.080798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.081082 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.084887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.084887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.084887 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.094167 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1358/2721] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:22.098075 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.107769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5472712-1a47-4861-81a0-f4aed64a8d34 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.111038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1364/2722] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:21 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:22.112554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fd39c-b645-4930-9a2e-696a46c411a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.113435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fd39c-b645-4930-9a2e-696a46c411a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.113554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.113734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fd39c-b645-4930-9a2e-696a46c411a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.114003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fd39c-b645-4930-9a2e-696a46c411a8 admin admin] PATH_INFO: `/v3/projects/8f97cd8e31db4889acf72ccef76ebf42/users/4ea84718d488440a8d5e3c4eb7c8daac/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.123254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dd061-3639-4d62-b022-867c6bc1df5f admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.127909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.128732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.129099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.129461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.130081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fd39c-b645-4930-9a2e-696a46c411a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f97cd8e31db4889acf72ccef76ebf42, user_id=4ea84718d488440a8d5e3c4eb7c8daac, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.130512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.141752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.142040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fd39c-b645-4930-9a2e-696a46c411a8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.143308 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1365/2723] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:22.150665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.160691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d0f7-1b5f-4192-8f44-f25bf6ffcabb admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.166362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.167291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.167629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.176066 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] PATH_INFO: `/v3/projects/201aafa7edd349adb0000d3e86e821b2/users/2a7396ba18814d4db1a03ee7f82a69e6/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.192732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201aafa7edd349adb0000d3e86e821b2, user_id=2a7396ba18814d4db1a03ee7f82a69e6, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.197549 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.244727 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1359/2724] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:22 2022] PUT /identity/v3/projects/8f97cd8e31db4889acf72ccef76ebf42/users/4ea84718d488440a8d5e3c4eb7c8daac/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:22.246012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fdae8-161e-4b6c-8786-2c977c6e4137 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.246305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fdae8-161e-4b6c-8786-2c977c6e4137 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.246585 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fdae8-161e-4b6c-8786-2c977c6e4137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.264208 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-411fdae8-161e-4b6c-8786-2c977c6e4137 None None] MFA Rules not processed for user `b33d4f6ecdc546efb061a8ada013d85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:22.267201 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-411fdae8-161e-4b6c-8786-2c977c6e4137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:22.318250 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1360/2725] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:22.319725 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.320014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.320287 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.326945 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1366/2726] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:22 2022] PUT /identity/v3/projects/201aafa7edd349adb0000d3e86e821b2/users/2a7396ba18814d4db1a03ee7f82a69e6/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:22.332747 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.354699 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] MFA Rules not processed for user `4ea84718d488440a8d5e3c4eb7c8daac`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:22.355588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:22.389299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:22.405180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c7b92-7df1-42c9-ba4a-c2dc813a8779 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.410703 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.411537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.411929 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.412341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.413939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.414988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.425956 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1367/2727] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:22.429832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.440676 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd2f8e-f813-424f-be65-795996f961c0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.446120 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7704083-2316-4484-81fb-0e1fef50cc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.447711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704083-2316-4484-81fb-0e1fef50cc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.448013 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704083-2316-4484-81fb-0e1fef50cc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.448300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7704083-2316-4484-81fb-0e1fef50cc63 admin admin] PATH_INFO: `/v3/projects/201aafa7edd349adb0000d3e86e821b2/users/2a7396ba18814d4db1a03ee7f82a69e6/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.450717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704083-2316-4484-81fb-0e1fef50cc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201aafa7edd349adb0000d3e86e821b2, user_id=2a7396ba18814d4db1a03ee7f82a69e6, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.451961 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1361/2728] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:22.454119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7704083-2316-4484-81fb-0e1fef50cc63 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.458242 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:22.463953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.465730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:22.472726 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1368/2729] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:22 2022] PUT /identity/v3/projects/201aafa7edd349adb0000d3e86e821b2/users/2a7396ba18814d4db1a03ee7f82a69e6/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:22.479557 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.480300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.480576 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.515787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] MFA Rules not processed for user `2a7396ba18814d4db1a03ee7f82a69e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:22.517010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:22.535554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc91ead-c9dd-4230-8a0a-7d5cdb863b13 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.596682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1369/2730] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:22.606895 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.608594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.608594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.608872 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.609029 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.610147 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:22.623281 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7fc06-80c4-4492-9ed7-d171f674ee0a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.626971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.627730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.627943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.628216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.638729 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.640432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.652466 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1370/2731] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:22.675417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.676892 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.687446 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1362/2732] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:22.707360 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.775131 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:22.784011 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc774c-eb4e-4d51-be94-627526d6ad43 service cinder] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.784194 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63059e-e0e4-4510-a33f-5dcaa76abb74 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:22.788393 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c468d1-49e3-41ef-83f4-7a3f048d9e5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.789099 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:22.789246 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c468d1-49e3-41ef-83f4-7a3f048d9e5d service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.789437 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c468d1-49e3-41ef-83f4-7a3f048d9e5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.789834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c468d1-49e3-41ef-83f4-7a3f048d9e5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.790191 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:22.790414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:22.791255 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] PATH_INFO: `/v3/users/4ea84718d488440a8d5e3c4eb7c8daac` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:22.792584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea84718d488440a8d5e3c4eb7c8daac)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.794593 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.851095 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c468d1-49e3-41ef-83f4-7a3f048d9e5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:22.852530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c468d1-49e3-41ef-83f4-7a3f048d9e5d service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:22.865048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1363/2733] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:23.021218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea84718d488440a8d5e3c4eb7c8daac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.021883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea84718d488440a8d5e3c4eb7c8daac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.106776 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea84718d488440a8d5e3c4eb7c8daac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.109266 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:23.115868 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea84718d488440a8d5e3c4eb7c8daac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.116685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea84718d488440a8d5e3c4eb7c8daac'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.134060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1371/2734] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:22 2022] DELETE /identity/v3/users/4ea84718d488440a8d5e3c4eb7c8daac => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:23.138618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:23.144519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:23.144519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:23.157005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:23.158212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:23.216578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1364/2735] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:23.226322 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:23.228241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:23.234654 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:23.293302 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cde71f-9421-4dc5-be2e-ba37f575d141 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:23.296996 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34eb7d-dd84-4485-8915-a45e497328ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:23.297658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34eb7d-dd84-4485-8915-a45e497328ff service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:23.297938 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34eb7d-dd84-4485-8915-a45e497328ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:23.298208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34eb7d-dd84-4485-8915-a45e497328ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:23.307442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34eb7d-dd84-4485-8915-a45e497328ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:23.308914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34eb7d-dd84-4485-8915-a45e497328ff service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:23.318128 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1372/2736] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:23.776354 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:23.778002 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:23.789655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374c31-22d9-46f3-8322-7994272dc043 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:23.794653 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:23.795456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:23.795768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:23.797171 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] PATH_INFO: `/v3/projects/8f97cd8e31db4889acf72ccef76ebf42` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:23.798965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f97cd8e31db4889acf72ccef76ebf42)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:23.800976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:23.961635 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f97cd8e31db4889acf72ccef76ebf42', 'request_id': 'req-0474a9f6-7c0c-423d-b989-1603c7214e3e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.967625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f97cd8e31db4889acf72ccef76ebf42', 'request_id': 'req-0474a9f6-7c0c-423d-b989-1603c7214e3e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:23.974304 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f97cd8e31db4889acf72ccef76ebf42', 'request_id': 'req-0474a9f6-7c0c-423d-b989-1603c7214e3e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:24.052251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:24.097721 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] The token cache is being invalidate because project 8f97cd8e31db4889acf72ccef76ebf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:24.098014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:24.099263 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-0474a9f6-7c0c-423d-b989-1603c7214e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:24.101091 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1365/2737] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:23 2022] DELETE /identity/v3/projects/8f97cd8e31db4889acf72ccef76ebf42 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:24.106523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.107475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.107475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.115386 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:24.126990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:24.128039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:24.188697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1373/2738] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:24.198176 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.198491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.198801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.218631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:24.219835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:24.228958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1366/2739] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:24.233061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:24.244698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b916c-5842-4be4-96c7-5fa558f91972 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:24.249338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:24.249997 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.250279 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.250554 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.251289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:24.251605 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:24.253225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:24.265332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1374/2740] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:42:24.269627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:24.279473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccab42-602f-4b52-9c67-b04826ad1236 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:24.284359 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:24.285052 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.285360 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.285637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.286346 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:24.288298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:24.413714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1367/2741] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:24 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:24.418504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:24.428524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15522df-f01f-46fb-bfe7-7bb4cbb3f4f4 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:24.484858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:24.485539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.485818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.486092 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.486824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:24.488766 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:24.595416 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1375/2742] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:24 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:24.599570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:24.610423 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc4178c-b6fb-4714-b56a-1c012891b72d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:24.615015 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:24.615691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.615972 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.616245 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.617473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:24.618637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:24.628826 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1368/2743] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:24.632677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:24.642685 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ac725-7df7-4154-a6ce-f58aea680f35 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:24.647474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7190134-b3c2-49b1-8ddf-faa7cd071101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:24.648112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7190134-b3c2-49b1-8ddf-faa7cd071101 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.648393 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7190134-b3c2-49b1-8ddf-faa7cd071101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.648702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7190134-b3c2-49b1-8ddf-faa7cd071101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.649425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7190134-b3c2-49b1-8ddf-faa7cd071101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:24.651707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7190134-b3c2-49b1-8ddf-faa7cd071101 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:24.661768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1376/2744] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:24.666485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:24.677329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f7439-37f3-4ff5-8c8f-6c355c46933c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:24.682155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:24.683068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.683352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.683623 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] PATH_INFO: `/v3/projects/62119475143e4f959317799444a4a1d5/users/1ad401a8fd1c4423bb3b599f0517bf43/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.699608 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62119475143e4f959317799444a4a1d5, user_id=1ad401a8fd1c4423bb3b599f0517bf43, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:24.702316 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:24.824907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1369/2745] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:24 2022] PUT /identity/v3/projects/62119475143e4f959317799444a4a1d5/users/1ad401a8fd1c4423bb3b599f0517bf43/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:24.835736 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:24.836063 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:24.836348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:24.862913 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] MFA Rules not processed for user `1ad401a8fd1c4423bb3b599f0517bf43`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:24.864129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:24.929178 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:24.933716 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1377/2746] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:25.027469 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:25.029260 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:25.089535 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:25.093908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2408a0-cd9f-49d7-b5ee-9e2a0ab68cc5 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:25.098496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b42cf-c6a2-4e25-a2a0-dd5055c71848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:25.099242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b42cf-c6a2-4e25-a2a0-dd5055c71848 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:25.099530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b42cf-c6a2-4e25-a2a0-dd5055c71848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:25.099807 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b42cf-c6a2-4e25-a2a0-dd5055c71848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:25.114375 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b42cf-c6a2-4e25-a2a0-dd5055c71848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:25.116033 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b42cf-c6a2-4e25-a2a0-dd5055c71848 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:25.127270 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1370/2747] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:28.769881 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:28.772746 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:28.844412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dc133-f316-4c8d-b2fd-687204c018ae None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:28.849768 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:28.850832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:28.851118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:28.851392 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] PATH_INFO: `/v3/users/fe5d8be646bb499a94e3212c59a58ccb` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:28.852750 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5d8be646bb499a94e3212c59a58ccb)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:28.855368 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:29.087399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5d8be646bb499a94e3212c59a58ccb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.087971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5d8be646bb499a94e3212c59a58ccb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.145712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5d8be646bb499a94e3212c59a58ccb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.154358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5d8be646bb499a94e3212c59a58ccb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.155049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5d8be646bb499a94e3212c59a58ccb'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.174241 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1378/2748] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:28 2022] DELETE /identity/v3/users/fe5d8be646bb499a94e3212c59a58ccb => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:29.178760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:29.179251 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:29.179352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:29.198856 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:29.199989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:29.261282 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1371/2749] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 20:42:29.271050 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:29.272475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:29.331357 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d2084-d398-4005-a629-2052471dbb66 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:29.335026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:29.335671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:29.335958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:29.336237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:29.346098 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:29.347465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:29.356955 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1379/2750] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:29.817769 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:29.819212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:29.832028 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e54f2-bdd2-4d88-99e5-1546952d81a7 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:29.837097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:29.838122 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:29.838707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:29.839105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] PATH_INFO: `/v3/projects/12664ab163ae4b3da80a436b2e781544` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:29.840478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12664ab163ae4b3da80a436b2e781544)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:29.842488 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:29.952113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12664ab163ae4b3da80a436b2e781544', 'request_id': 'req-150f3153-9256-4fd4-80d1-4c058066bfd0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.957997 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12664ab163ae4b3da80a436b2e781544', 'request_id': 'req-150f3153-9256-4fd4-80d1-4c058066bfd0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:29.964024 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12664ab163ae4b3da80a436b2e781544', 'request_id': 'req-150f3153-9256-4fd4-80d1-4c058066bfd0'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.041113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] The token cache is being invalidate because project 12664ab163ae4b3da80a436b2e781544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:30.041400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.042676 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.044219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1372/2751] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:29 2022] DELETE /identity/v3/projects/12664ab163ae4b3da80a436b2e781544 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:30.048260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:30.071300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf4b98-96cf-49ea-95ef-e4670730c485 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:30.092429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:30.143036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:30.143999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:30.144432 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:30.144805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] PATH_INFO: `/v3/users/2a7396ba18814d4db1a03ee7f82a69e6` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:30.146783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7396ba18814d4db1a03ee7f82a69e6)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:30.148914 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:30.360431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7396ba18814d4db1a03ee7f82a69e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.361345 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7396ba18814d4db1a03ee7f82a69e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.431931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7396ba18814d4db1a03ee7f82a69e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.440284 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7396ba18814d4db1a03ee7f82a69e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.441044 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-82731619-62d7-4b8e-be1c-7f0e32bac97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7396ba18814d4db1a03ee7f82a69e6'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:30.458623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1380/2752] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:30 2022] DELETE /identity/v3/users/2a7396ba18814d4db1a03ee7f82a69e6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:30.992837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:30.994478 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:31.011853 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f3153-9256-4fd4-80d1-4c058066bfd0 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:31.072144 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:31.073784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.074069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.074345 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] PATH_INFO: `/v3/projects/201aafa7edd349adb0000d3e86e821b2` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.075537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=201aafa7edd349adb0000d3e86e821b2)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:31.077464 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:31.093013 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:31.191069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201aafa7edd349adb0000d3e86e821b2', 'request_id': 'req-f8d7576a-4523-47ea-b607-1c1ea5462784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:31.196591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201aafa7edd349adb0000d3e86e821b2', 'request_id': 'req-f8d7576a-4523-47ea-b607-1c1ea5462784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:31.207879 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201aafa7edd349adb0000d3e86e821b2', 'request_id': 'req-f8d7576a-4523-47ea-b607-1c1ea5462784'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:31.314666 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] The token cache is being invalidate because project 201aafa7edd349adb0000d3e86e821b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:31.315071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:31.315711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-f8d7576a-4523-47ea-b607-1c1ea5462784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:31.317363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1373/2753] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:30 2022] DELETE /identity/v3/projects/201aafa7edd349adb0000d3e86e821b2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:31.322762 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.324256 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.324539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.346310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:31.347794 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:31.417932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1381/2754] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:31.426738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.427131 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.427412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.453456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:31.453456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:31.459611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1374/2755] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:31.463684 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:31.474014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3281d-f072-4d6e-ab61-27611c5f422c None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:31.478933 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:31.479918 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.480343 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.480646 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.481438 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:31.481674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:31.483232 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:31.502399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1382/2756] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:42:31.503593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:31.514498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e42ca-edee-4922-bf38-2e0e2cd0a8f6 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:31.519550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:31.520283 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.520838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.521197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.522285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:31.524754 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:31.661125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1375/2757] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:31 2022] POST /identity/v3/projects => generated 393 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:31.662272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:31.674483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176ab48-59ff-4ba4-8564-a15119a0ac18 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:31.714027 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:31.751447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:31.752048 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.752332 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.752654 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.753487 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:31.755524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:31.931751 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1383/2758] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:31 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:31.934542 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:31.944777 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e59b1-a354-41ae-a6aa-7615311e8119 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:31.949649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:31.950305 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.950594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.950877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.951610 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:31.954737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:31.967944 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1376/2759] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:31.969135 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:31.980545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9858e7b-d5fb-43ff-b8fb-cd6e2f298bb1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:31.985268 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d64f8-7508-423b-a835-4b3b24f6642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:31.985925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d64f8-7508-423b-a835-4b3b24f6642b admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:31.986243 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d64f8-7508-423b-a835-4b3b24f6642b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:31.986525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d64f8-7508-423b-a835-4b3b24f6642b admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:31.987291 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d64f8-7508-423b-a835-4b3b24f6642b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:31.989053 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d64f8-7508-423b-a835-4b3b24f6642b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:31.999251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1384/2760] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:42:32.007636 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.017781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee4cb4-fa75-428e-ba89-902612788dbf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.022224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.024038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.024317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.024597 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] PATH_INFO: `/v3/projects/c433bb39a0a34357ba0caab23ea7fa0b/users/c3515fb60c4a46e3bff2d52e6c48565a/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.044662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c433bb39a0a34357ba0caab23ea7fa0b, user_id=c3515fb60c4a46e3bff2d52e6c48565a, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.047578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.123212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1377/2761] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:32 2022] PUT /identity/v3/projects/c433bb39a0a34357ba0caab23ea7fa0b/users/c3515fb60c4a46e3bff2d52e6c48565a/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:32.133631 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.133928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.134216 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.161459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] MFA Rules not processed for user `c3515fb60c4a46e3bff2d52e6c48565a`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:32.162720 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:32.227293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1385/2762] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:32.231713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.309603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e178-00cd-4f5b-951f-cee3e5d948ff admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.314931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.315917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.316401 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.316784 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.317495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.320063 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.324484 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.326366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:32.403788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5d59-bc85-4d9b-8a0e-9af37398ce32 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.405632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1378/2763] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:32 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:32.410595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.448207 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:32.460598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:32.483274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.483930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.487500 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.487855 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.490365 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:32.503197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357ef48-bdc4-41fd-985c-4275cadc3529 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.504536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.506301 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.509293 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.510801 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.511302 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.511744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.512671 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.514871 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.520390 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1386/2764] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:32.646673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1379/2765] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:32 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:42:32.650584 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.661018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845a80e-bf1e-4ec6-a538-fc3bf5ad3d7f service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.665671 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.666323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.666606 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.666943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.667613 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.669278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.679089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1387/2766] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:32.683991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.694214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d8730-e8a6-43fe-a6dd-880ad022b8b1 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.699728 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.700606 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.700910 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.701183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] PATH_INFO: `/v3/projects/ffe2c5527e524a27a288a43796f1e67b/users/84eeb7bc881e4c0cba499c71637a7e95/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.715966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe2c5527e524a27a288a43796f1e67b, user_id=84eeb7bc881e4c0cba499c71637a7e95, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.718734 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.827714 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1380/2767] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:32 2022] PUT /identity/v3/projects/ffe2c5527e524a27a288a43796f1e67b/users/84eeb7bc881e4c0cba499c71637a7e95/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:32.831690 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.843965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453de2bd-33f7-4e5f-aac1-6e2a57b25afa admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.901412 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820fb67-829c-488a-8ff6-b2fa423d00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.902081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fb67-829c-488a-8ff6-b2fa423d00cb admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.902366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fb67-829c-488a-8ff6-b2fa423d00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.902643 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820fb67-829c-488a-8ff6-b2fa423d00cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.903366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fb67-829c-488a-8ff6-b2fa423d00cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.905017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d820fb67-829c-488a-8ff6-b2fa423d00cb admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.915018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1388/2768] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:32.919793 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:32.930120 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49f9d-060e-4c16-8b31-db4018b8a549 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:32.935703 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:32.936583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.936908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.937241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] PATH_INFO: `/v3/projects/ffe2c5527e524a27a288a43796f1e67b/users/84eeb7bc881e4c0cba499c71637a7e95/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.939150 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe2c5527e524a27a288a43796f1e67b, user_id=84eeb7bc881e4c0cba499c71637a7e95, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:32.943272 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:32.954858 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1381/2769] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:32 2022] PUT /identity/v3/projects/ffe2c5527e524a27a288a43796f1e67b/users/84eeb7bc881e4c0cba499c71637a7e95/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:32.965132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:32.965452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:32.965758 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:32.991871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] MFA Rules not processed for user `84eeb7bc881e4c0cba499c71637a7e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:32.993172 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:33.059859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1389/2770] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:33.071060 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:33.072792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:33.133443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd59b57-f052-42f8-a3ac-f5d166837eab admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:33.137247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:33.137881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:33.138184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:33.138456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:33.147317 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:33.148797 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:33.158085 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1382/2771] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:33.203970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:33.205351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:33.217342 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa7667-b708-4e04-87cf-2fa8b93b28e2 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:33.220943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc186d5-27d7-43c6-9418-509e76de9851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:33.221571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc186d5-27d7-43c6-9418-509e76de9851 service cinder] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:33.221851 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc186d5-27d7-43c6-9418-509e76de9851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:33.222123 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc186d5-27d7-43c6-9418-509e76de9851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:33.251129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=100 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:33.278805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc186d5-27d7-43c6-9418-509e76de9851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:33.283391 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc186d5-27d7-43c6-9418-509e76de9851 service cinder] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:33.293061 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1390/2772] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:37.054669 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:37.056273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:37.124152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fed76f-8a06-4157-9902-4134e3b6a4d3 service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:37.129055 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:37.130838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:37.130838 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:37.131149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] PATH_INFO: `/v3/users/1ad401a8fd1c4423bb3b599f0517bf43` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:37.133134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ad401a8fd1c4423bb3b599f0517bf43)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:37.137117 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:37.163541 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:37.335570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ad401a8fd1c4423bb3b599f0517bf43'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:37.348196 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ad401a8fd1c4423bb3b599f0517bf43'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:37.348924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ad401a8fd1c4423bb3b599f0517bf43'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:37.355927 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ad401a8fd1c4423bb3b599f0517bf43'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:37.439494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ad401a8fd1c4423bb3b599f0517bf43'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:37.446380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1383/2773] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:37 2022] DELETE /identity/v3/users/1ad401a8fd1c4423bb3b599f0517bf43 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:37.451157 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:37.451686 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:37.451792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:37.470072 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:37.471804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:37.533555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1391/2774] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:37.544110 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:37.545707 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:37.610906 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e234c3-5e7f-4305-99d6-275cb8b889d2 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:37.614655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:37.615308 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:37.615837 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:37.615976 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:37.627979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:37.629609 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:37.640175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1384/2775] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:38.070719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:38.070719 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:38.079681 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c19b3-4d45-465a-bc07-6a08e65ab28a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:38.085665 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:38.086619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:38.087047 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:38.087265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] PATH_INFO: `/v3/projects/62119475143e4f959317799444a4a1d5` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:38.089483 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62119475143e4f959317799444a4a1d5)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:38.091429 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:38.196765 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62119475143e4f959317799444a4a1d5', 'request_id': 'req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.203660 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62119475143e4f959317799444a4a1d5', 'request_id': 'req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.262965 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62119475143e4f959317799444a4a1d5', 'request_id': 'req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.275578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] The token cache is being invalidate because project 62119475143e4f959317799444a4a1d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:38.275859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.277151 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-da8a133c-a9cb-4fdf-b5aa-b6d69c35ae06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.278803 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1392/2776] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:38 2022] DELETE /identity/v3/projects/62119475143e4f959317799444a4a1d5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:38.453706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:38.455280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:38.469452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945ac43-3e2f-4286-a7dc-f0bb78e8cb16 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:38.549900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:38.550792 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:38.551074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:38.551349 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] PATH_INFO: `/v3/users/c3515fb60c4a46e3bff2d52e6c48565a` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:38.552562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3515fb60c4a46e3bff2d52e6c48565a)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:38.554511 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:38.796191 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:38.798742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3515fb60c4a46e3bff2d52e6c48565a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.810791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3515fb60c4a46e3bff2d52e6c48565a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.813515 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3515fb60c4a46e3bff2d52e6c48565a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.818745 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3515fb60c4a46e3bff2d52e6c48565a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.888230 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-6072423c-c3e9-49f2-9bd1-cdaca7bc6dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3515fb60c4a46e3bff2d52e6c48565a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:38.894867 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1385/2777] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:38 2022] DELETE /identity/v3/users/c3515fb60c4a46e3bff2d52e6c48565a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:38.899694 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:38.899977 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:38.900433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:38.900433 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:38.900674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:38.900674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:38.919210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:38.920780 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:38.921307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:38.922525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:38.974711 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:38.983024 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1386/2778] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:38.987461 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1393/2779] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:38.997940 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:38.998201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:38.999331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:38.999545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:39.061445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d1dd7-7b6d-49bb-a0a1-300dee738b4b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:39.065011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:39.065656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:39.065939 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:39.066242 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:39.076954 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:39.078409 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:39.080902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0746c9-bbd3-4e32-ba44-4167bf898610 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:39.087555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:39.087555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:39.087555 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:39.088026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:39.088977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1387/2780] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:39.099857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:39.101475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:39.111899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1394/2781] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:42:39.523829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:39.525494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:39.548756 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8d134-4542-42f7-abc3-e492500e2ba1 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:39.567536 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:39.568355 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:39.568665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:39.568949 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] PATH_INFO: `/v3/projects/c433bb39a0a34357ba0caab23ea7fa0b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:39.570572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c433bb39a0a34357ba0caab23ea7fa0b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:39.572309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:39.673206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c433bb39a0a34357ba0caab23ea7fa0b', 'request_id': 'req-5f13f354-8931-42c0-be92-4c3bc68a3bfb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:39.679001 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c433bb39a0a34357ba0caab23ea7fa0b', 'request_id': 'req-5f13f354-8931-42c0-be92-4c3bc68a3bfb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:39.680079 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:39.686074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c433bb39a0a34357ba0caab23ea7fa0b', 'request_id': 'req-5f13f354-8931-42c0-be92-4c3bc68a3bfb'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:39.774403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] The token cache is being invalidate because project c433bb39a0a34357ba0caab23ea7fa0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:39.774692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:39.775313 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:39.777567 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1388/2782] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:39 2022] DELETE /identity/v3/projects/c433bb39a0a34357ba0caab23ea7fa0b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:39.781683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:39.791225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db90b073-9b1e-41bf-87f4-11a58b25a0a7 service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:39.852414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:39.853223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:39.853504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:39.853777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] PATH_INFO: `/v3/users/84eeb7bc881e4c0cba499c71637a7e95` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:39.854954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84eeb7bc881e4c0cba499c71637a7e95)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:39.856879 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:40.041507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84eeb7bc881e4c0cba499c71637a7e95'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.042854 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84eeb7bc881e4c0cba499c71637a7e95'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.119658 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84eeb7bc881e4c0cba499c71637a7e95'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.127185 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84eeb7bc881e4c0cba499c71637a7e95'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.127823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-d6b1ff88-51bf-4ae9-822f-df07491eeee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84eeb7bc881e4c0cba499c71637a7e95'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.140273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:40.145324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1395/2783] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:39 2022] DELETE /identity/v3/users/84eeb7bc881e4c0cba499c71637a7e95 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:40.584312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:40.585870 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:40.601855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13f354-8931-42c0-be92-4c3bc68a3bfb admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:40.665321 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:40.666258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:40.671689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:40.671689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] PATH_INFO: `/v3/projects/ffe2c5527e524a27a288a43796f1e67b` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:40.671689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe2c5527e524a27a288a43796f1e67b)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:40.671689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:40.780142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe2c5527e524a27a288a43796f1e67b', 'request_id': 'req-611df3c2-335b-4576-81b9-e45bcd8d105b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.785576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe2c5527e524a27a288a43796f1e67b', 'request_id': 'req-611df3c2-335b-4576-81b9-e45bcd8d105b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.791656 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe2c5527e524a27a288a43796f1e67b', 'request_id': 'req-611df3c2-335b-4576-81b9-e45bcd8d105b'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.856107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] The token cache is being invalidate because project ffe2c5527e524a27a288a43796f1e67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:40.856396 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.857042 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-611df3c2-335b-4576-81b9-e45bcd8d105b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:40.858587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1389/2784] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:40 2022] DELETE /identity/v3/projects/ffe2c5527e524a27a288a43796f1e67b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:40.863464 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439898-c114-497e-ac34-883e371ee32b None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:40.863863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439898-c114-497e-ac34-883e371ee32b None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:40.864154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35439898-c114-497e-ac34-883e371ee32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:40.884859 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-35439898-c114-497e-ac34-883e371ee32b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:40.886717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-35439898-c114-497e-ac34-883e371ee32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:40.945614 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1396/2785] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:40.955046 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:40.955337 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:40.955618 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:40.974702 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:40.975907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:40.983880 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1390/2786] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:40.988377 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439898-c114-497e-ac34-883e371ee32b None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:40.998597 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35439898-c114-497e-ac34-883e371ee32b None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.003169 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.003817 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.004100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.004375 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.005129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:42:41.005431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.006990 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.021101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1397/2787] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 20:42:41.025496 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:41.034633 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f58fef-8bb1-4c39-b89d-cdf9e6326355 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.039973 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.041008 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.041455 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.041802 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.042539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.045834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.144249 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1391/2788] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:42:41 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:41.148341 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:41.158362 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436904ea-c0d8-47ca-878a-fc86315eb092 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.216983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.217577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.217858 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.218161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.218889 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.220811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.336788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1398/2789] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:42:41 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:42:41.340912 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:41.351294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4769e4-7e57-4ffa-9aec-90e5936bb369 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.356711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.357376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.360803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.360803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.360803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.360803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.373265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1392/2790] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:41.377791 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:41.389548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17162225-1b80-488e-8830-26fcb92e3068 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.394734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3ff2d-46ea-467d-934a-711073ef38ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.395860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ff2d-46ea-467d-934a-711073ef38ea admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.396354 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ff2d-46ea-467d-934a-711073ef38ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.397253 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3ff2d-46ea-467d-934a-711073ef38ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.398588 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3ff2d-46ea-467d-934a-711073ef38ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.401662 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3ff2d-46ea-467d-934a-711073ef38ea admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.413205 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1399/2791] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:42:41.418173 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:41.428239 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8604a-ef7e-4fb2-8a8d-e31c851c95a4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.433849 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.434726 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.435072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.435328 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] PATH_INFO: `/v3/projects/a621a3d9815343d7b9462798c6582b93/users/a3dc3008f1594c59b3826c7e3ef1a78d/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.451650 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a621a3d9815343d7b9462798c6582b93, user_id=a3dc3008f1594c59b3826c7e3ef1a78d, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.456182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.534516 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1393/2792] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:42:41 2022] PUT /identity/v3/projects/a621a3d9815343d7b9462798c6582b93/users/a3dc3008f1594c59b3826c7e3ef1a78d/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:42:41.539691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514eea-e398-4173-8093-2d4a1a8ecdb1 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.539987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514eea-e398-4173-8093-2d4a1a8ecdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.540264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80514eea-e398-4173-8093-2d4a1a8ecdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.559083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-80514eea-e398-4173-8093-2d4a1a8ecdb1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:41.560292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-80514eea-e398-4173-8093-2d4a1a8ecdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:41.619853 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1400/2793] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:41.630818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:41.632720 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:41.649591 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:41.699495 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ccf1da-9ea4-4f96-b16b-539b08641722 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:41.703417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:41.704068 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:41.704357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:41.704659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:41.719506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:41.719506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:41.735280 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1394/2794] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:42.376923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efec8b-912f-4f49-9913-166db961b44a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:42.377517 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efec8b-912f-4f49-9913-166db961b44a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:42.377873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efec8b-912f-4f49-9913-166db961b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:42.388183 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:42.399142 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f4efec8b-912f-4f49-9913-166db961b44a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:42.400348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f4efec8b-912f-4f49-9913-166db961b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:42.408831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1401/2795] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:42.424073 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:42.431253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:42.511510 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09beb2c-7bc3-4ee4-b4f9-0bfd24fd4983 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:42.517312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:42.518006 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:42.518297 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:42.518579 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:42.528203 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:42.529877 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:42.541011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1395/2796] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:43.156564 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de873-4de8-4fe4-80f9-8287067064e5 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:43.156957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de873-4de8-4fe4-80f9-8287067064e5 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:43.157202 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de873-4de8-4fe4-80f9-8287067064e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:43.185462 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-b39de873-4de8-4fe4-80f9-8287067064e5 None None] MFA Rules not processed for user `a3dc3008f1594c59b3826c7e3ef1a78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:43.186691 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-b39de873-4de8-4fe4-80f9-8287067064e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:43.258174 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1402/2797] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:43.269692 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:43.271180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:43.327744 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8c1a9-5e49-4b71-baff-5bd09b3f3fe3 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:43.331175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:43.331810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:43.332103 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:43.332364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:43.341572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:43.343020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:43.352081 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1396/2798] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:45.001317 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e13a-cbac-4716-b0de-c17062f9417a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:45.003275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e13a-cbac-4716-b0de-c17062f9417a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:45.003275 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069e13a-cbac-4716-b0de-c17062f9417a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:45.019045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2069e13a-cbac-4716-b0de-c17062f9417a None None] MFA Rules not processed for user `a3dc3008f1594c59b3826c7e3ef1a78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:45.020235 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2069e13a-cbac-4716-b0de-c17062f9417a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:45.027004 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1403/2799] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:45.259658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:45.261084 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:45.273131 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecdb25-d7ce-497e-a114-fc416906ce8c service cinder] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:45.280147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:45.280147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:45.280147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:45.280147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:45.284026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:45.295187 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:45.296660 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:45.304907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1397/2800] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:45.308882 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3b975-06cd-4111-a8a1-8caeddf2adfa None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:45.309182 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3b975-06cd-4111-a8a1-8caeddf2adfa None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:45.309459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3b975-06cd-4111-a8a1-8caeddf2adfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:45.327370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-80d3b975-06cd-4111-a8a1-8caeddf2adfa None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:45.331702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-80d3b975-06cd-4111-a8a1-8caeddf2adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:45.337181 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1404/2801] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:45.357883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:45.371211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea25d9b-b22f-45ea-80d4-cc692cc21dbf service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:45.377152 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:45.377796 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:45.378083 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:45.378362 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:45.386851 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:45.388471 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:45.400893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1398/2802] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:48.552786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e02ee-4d9d-4ef9-8b3d-0445e8ea7aea None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:48.552786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e02ee-4d9d-4ef9-8b3d-0445e8ea7aea None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:48.552786 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e02ee-4d9d-4ef9-8b3d-0445e8ea7aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:48.565282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-5f9e02ee-4d9d-4ef9-8b3d-0445e8ea7aea None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:48.566490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-5f9e02ee-4d9d-4ef9-8b3d-0445e8ea7aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:48.574731 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1405/2803] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:48.588942 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:48.600860 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ef094-c54a-49be-a41d-a57702092eb8 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:48.606436 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:48.610625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:48.610625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:48.610625 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:48.615974 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:48.617569 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:48.627803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1399/2804] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:51.795245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:51.795843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:51.795988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:51.814876 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:51.816079 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:51.827826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1406/2805] 10.222.0.71 () {58 vars in 1016 bytes} [Thu Jun 16 20:42:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:51.838991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:51.840506 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:51.851755 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=100 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:51.855994 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfc370-b7ed-4b41-8814-67d1f2581e45 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:51.861810 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41dd69-c19d-4ec9-ba6f-241e33801b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:51.862482 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41dd69-c19d-4ec9-ba6f-241e33801b74 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:51.862768 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41dd69-c19d-4ec9-ba6f-241e33801b74 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:51.863043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41dd69-c19d-4ec9-ba6f-241e33801b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:51.871472 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41dd69-c19d-4ec9-ba6f-241e33801b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:51.873071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41dd69-c19d-4ec9-ba6f-241e33801b74 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:51.883398 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1400/2806] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:53.016857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:53.018274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:53.029957 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db0c79-fa07-4a4e-a27a-1527955246c0 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:53.035127 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:53.036078 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:53.036381 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:53.036695 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] PATH_INFO: `/v3/users/9263dac930b747da8fbaddfcfe404884` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:53.037871 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9263dac930b747da8fbaddfcfe404884)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:53.039784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:53.226631 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9263dac930b747da8fbaddfcfe404884'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:53.227280 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9263dac930b747da8fbaddfcfe404884'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:53.313475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9263dac930b747da8fbaddfcfe404884'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:53.321110 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9263dac930b747da8fbaddfcfe404884'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:53.324734 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9263dac930b747da8fbaddfcfe404884'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:53.339583 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1407/2807] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:42:53 2022] DELETE /identity/v3/users/9263dac930b747da8fbaddfcfe404884 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:42:53.344207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:53.344686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:53.344814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:53.361791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:42:53.362979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:53.421179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1401/2808] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:42:53.431383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:53.432843 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:53.473443 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:42:53.495966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b1529-14f9-4c55-bc40-269601059efc admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:53.500439 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b69d31-5508-4bc6-8129-106ff051daa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:53.508700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69d31-5508-4bc6-8129-106ff051daa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:53.508700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69d31-5508-4bc6-8129-106ff051daa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:53.508700 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b69d31-5508-4bc6-8129-106ff051daa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:53.511068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b69d31-5508-4bc6-8129-106ff051daa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:53.512629 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b69d31-5508-4bc6-8129-106ff051daa7 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:53.522521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1408/2809] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:42:54.039868 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:42:54.041315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:42:54.053908 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425ef84-59f4-4ffd-8fec-e0e09503da4b None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:42:54.058762 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:42:54.059630 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:42:54.059945 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:42:54.060225 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] PATH_INFO: `/v3/projects/5f28eebfe12849a18866054101c4aa9f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:42:54.062071 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f28eebfe12849a18866054101c4aa9f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:42:54.064005 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:42:54.169405 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f28eebfe12849a18866054101c4aa9f', 'request_id': 'req-c5d485e1-3588-4f8a-b0fd-24293cfc734e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:54.175388 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f28eebfe12849a18866054101c4aa9f', 'request_id': 'req-c5d485e1-3588-4f8a-b0fd-24293cfc734e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:54.181498 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f28eebfe12849a18866054101c4aa9f', 'request_id': 'req-c5d485e1-3588-4f8a-b0fd-24293cfc734e'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:54.248402 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] The token cache is being invalidate because project 5f28eebfe12849a18866054101c4aa9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:42:54.248722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:54.249340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:42:54.250900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1402/2810] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:42:54 2022] DELETE /identity/v3/projects/5f28eebfe12849a18866054101c4aa9f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:43:03.855538 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=11 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:04.245392 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:09.307988 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:09.308521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:09.308521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:09.326086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] MFA Rules not processed for user `a3dc3008f1594c59b3826c7e3ef1a78d`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:43:09.327270 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:09.380539 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1409/2811] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:43:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:43:19.373973 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=25 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:25.160161 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:25.161661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:25.229238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d485e1-3588-4f8a-b0fd-24293cfc734e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:25.233843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:25.234718 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:25.235007 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:25.235286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] PATH_INFO: `/v3/users/b33d4f6ecdc546efb061a8ada013d85f` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:25.237058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b33d4f6ecdc546efb061a8ada013d85f)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:25.238990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:25.416803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b33d4f6ecdc546efb061a8ada013d85f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:25.429247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b33d4f6ecdc546efb061a8ada013d85f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:25.429964 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b33d4f6ecdc546efb061a8ada013d85f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:25.436901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b33d4f6ecdc546efb061a8ada013d85f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:25.516956 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-7a19e2bc-74d4-414d-bebe-a22f05bb8653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b33d4f6ecdc546efb061a8ada013d85f'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:25.523428 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1403/2812] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:43:25 2022] DELETE /identity/v3/users/b33d4f6ecdc546efb061a8ada013d85f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:43:25.793049 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:25.805347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d06906-6ed2-4f19-99a1-1f44b5de78cd None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:25.868289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:25.869176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:25.869459 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:25.869735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] PATH_INFO: `/v3/projects/4154b166ffde49c984d4898a623c5e0a` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:25.870923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4154b166ffde49c984d4898a623c5e0a)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:25.872862 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:26.029510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4154b166ffde49c984d4898a623c5e0a', 'request_id': 'req-47c19693-6293-43af-b248-f7be9f4073a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:26.035728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4154b166ffde49c984d4898a623c5e0a', 'request_id': 'req-47c19693-6293-43af-b248-f7be9f4073a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:26.093954 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4154b166ffde49c984d4898a623c5e0a', 'request_id': 'req-47c19693-6293-43af-b248-f7be9f4073a1'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:26.104560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] The token cache is being invalidate because project 4154b166ffde49c984d4898a623c5e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:43:26.104874 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:26.105489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:26.107018 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1410/2813] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:43:25 2022] DELETE /identity/v3/projects/4154b166ffde49c984d4898a623c5e0a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:43:27.114206 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df62a-1bd5-4942-af91-062d7db9fcda None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:27.114724 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df62a-1bd5-4942-af91-062d7db9fcda None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:27.114833 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4df62a-1bd5-4942-af91-062d7db9fcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:27.132690 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-cc4df62a-1bd5-4942-af91-062d7db9fcda None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:43:27.133885 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-cc4df62a-1bd5-4942-af91-062d7db9fcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:27.189644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1404/2814] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:43:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:43:27.324827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:27.326228 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:27.395923 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c19693-6293-43af-b248-f7be9f4073a1 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:27.400837 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:27.401505 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:27.401790 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:27.402071 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:27.410481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:27.412035 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:27.419796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1411/2815] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:43:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:43:37.182624 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:37.416730 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:43.798069 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:43.798562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:43.798673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:43.815966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:43:43.817211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:43.824550 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1405/2816] 10.222.0.65 () {58 vars in 967 bytes} [Thu Jun 16 20:43:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:43:43.836823 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:43.847702 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6a24d-8599-4c04-adf6-5ad00dddb6b2 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:43.852577 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:43.853231 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:43.853511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:43.853787 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:43.861581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:43.863145 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:43.871094 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1412/2817] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:43:46.801765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:46.803221 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:46.868491 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19a71-15ab-443b-a626-ceafb4090784 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:46.873210 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:46.874072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:46.874352 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:46.874626 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] PATH_INFO: `/v3/users/a3dc3008f1594c59b3826c7e3ef1a78d` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:46.875819 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3dc3008f1594c59b3826c7e3ef1a78d)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:46.878012 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:47.052017 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3dc3008f1594c59b3826c7e3ef1a78d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.063572 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3dc3008f1594c59b3826c7e3ef1a78d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.064247 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3dc3008f1594c59b3826c7e3ef1a78d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.071299 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3dc3008f1594c59b3826c7e3ef1a78d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.146519 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-e71c6cf1-d78f-4035-a970-fc70871bc99e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3dc3008f1594c59b3826c7e3ef1a78d'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.152528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1406/2818] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:43:46 2022] DELETE /identity/v3/users/a3dc3008f1594c59b3826c7e3ef1a78d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:43:47.397039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:47.407552 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cb76f-8e6f-4444-a7e2-f6d2719b58d5 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:47.462498 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:47.463349 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:47.463630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:47.463928 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] PATH_INFO: `/v3/projects/a621a3d9815343d7b9462798c6582b93` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:47.465134 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a621a3d9815343d7b9462798c6582b93)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:47.467038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:47.568567 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a621a3d9815343d7b9462798c6582b93', 'request_id': 'req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.575081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a621a3d9815343d7b9462798c6582b93', 'request_id': 'req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.646246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a621a3d9815343d7b9462798c6582b93', 'request_id': 'req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.657251 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] The token cache is being invalidate because project a621a3d9815343d7b9462798c6582b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:43:47.657540 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.658158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-fe2808c4-0cf9-43ea-ac63-1ae30a9d1961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:43:47.659741 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1413/2819] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:43:47 2022] DELETE /identity/v3/projects/a621a3d9815343d7b9462798c6582b93 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:43:47.664592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:47.664916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:47.665195 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:47.683479 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:43:47.684722 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:47.744197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1407/2820] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:43:47.752016 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:47.752316 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:47.752599 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:47.770677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:43:47.771875 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:47.780218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1414/2821] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:43:47.785113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:47.795371 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46abd8-ed3f-4993-9732-c8858f03f69a None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:47.800480 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:47.801169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:47.801454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:47.801728 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:47.802456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:43:47.802990 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:47.804350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:47.813160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:47.816576 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1408/2822] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:43:47.821208 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:47.831052 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237995a-0f92-4baf-8a63-df082a6494d6 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:47.835985 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:47.836668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:47.836961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:47.837236 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:47.838223 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:47.840578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:47.926017 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1415/2823] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:43:47 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:43:47.929594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:47.939444 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4350-ad56-4118-8cbd-d941420cb80a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:47.994962 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:47.995629 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:47.995913 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:47.996190 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:47.996917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:47.998818 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:48.092526 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1409/2824] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:43:47 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:43:48.097273 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:48.107476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c3cf4-c605-4238-8677-eaee0f8c8aa6 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:48.116405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:48.116405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:48.116405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:48.116405 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:48.116905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:48.116905 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:48.126422 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1416/2825] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:43:48.130183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:48.139832 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd66dc5-eefd-4220-b273-79b647006151 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:48.144917 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceee245-6269-4298-8d30-cbdd086bffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:48.145573 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee245-6269-4298-8d30-cbdd086bffc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:48.145835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee245-6269-4298-8d30-cbdd086bffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:48.146105 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceee245-6269-4298-8d30-cbdd086bffc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:48.146816 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceee245-6269-4298-8d30-cbdd086bffc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:48.148383 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceee245-6269-4298-8d30-cbdd086bffc8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:48.158116 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1410/2826] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:43:48.162559 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:48.172479 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d33271-fb30-42cd-92bb-7156f38850fd admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:48.177164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:48.178038 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:48.178323 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:48.178600 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] PATH_INFO: `/v3/projects/490ea5e772fb403c9fd1a6b07dd61a1e/users/fd70172c18eb470da0cee14de0a2f228/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:48.198442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=490ea5e772fb403c9fd1a6b07dd61a1e, user_id=fd70172c18eb470da0cee14de0a2f228, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:48.201278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:48.300860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1417/2827] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:43:48 2022] PUT /identity/v3/projects/490ea5e772fb403c9fd1a6b07dd61a1e/users/fd70172c18eb470da0cee14de0a2f228/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:43:48.311076 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:48.311370 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:48.311652 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:48.337989 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] MFA Rules not processed for user `fd70172c18eb470da0cee14de0a2f228`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:43:48.339184 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:48.400487 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1411/2828] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:43:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:43:48.412299 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:48.414003 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:48.427912 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:48.469598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cd1c26-9471-4d29-8764-cd7d7ab5ea4b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:48.473840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:48.474475 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:48.474753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:48.475026 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:48.483103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:48.485409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:48.494262 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1418/2829] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:43:48 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:43:50.041731 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:43:50.043155 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:50.112584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7799b4e-3b6a-4786-adcf-a1fc253b833e None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:43:50.118212 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:43:50.118852 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:43:50.119137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:43:50.119412 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:43:50.121219 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:43:50.133835 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:43:50.135476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b4188-8865-40b1-82aa-fae576b953e7 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:43:50.140141 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:43:50.146627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1412/2830] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:43:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:43:58.512376 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=20 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:00.195026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:12.891156 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:12.952974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115c19c-e861-4b5d-8791-16659af2ce02 service glance] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:12.957511 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:12.958419 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:12.958697 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:12.958974 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] PATH_INFO: `/v3/users/fd70172c18eb470da0cee14de0a2f228` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:12.960154 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd70172c18eb470da0cee14de0a2f228)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:12.962615 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:13.126009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd70172c18eb470da0cee14de0a2f228'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.126632 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd70172c18eb470da0cee14de0a2f228'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.187631 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd70172c18eb470da0cee14de0a2f228'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.195195 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd70172c18eb470da0cee14de0a2f228'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.196348 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd70172c18eb470da0cee14de0a2f228'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.214224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1419/2831] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:44:12 2022] DELETE /identity/v3/users/fd70172c18eb470da0cee14de0a2f228 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:13.218641 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:13.219138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:13.219248 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:13.236162 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:13.237391 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:13.294862 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1413/2832] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:13.304455 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:13.305921 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:13.361894 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7562e-2396-4989-bdcc-844e86e274b0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:13.365523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39f546-5e10-4a94-889f-da33ff18d377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:13.366153 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f546-5e10-4a94-889f-da33ff18d377 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:13.366434 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f546-5e10-4a94-889f-da33ff18d377 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:13.366706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39f546-5e10-4a94-889f-da33ff18d377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:13.375804 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39f546-5e10-4a94-889f-da33ff18d377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:13.377325 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39f546-5e10-4a94-889f-da33ff18d377 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:13.387171 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1420/2833] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:44:13.783253 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:13.787803 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:13.801592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ce8c6-aa23-4d28-be9b-fb5d524d4e95 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:13.813400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:13.814256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:13.814530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:13.814799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] PATH_INFO: `/v3/projects/490ea5e772fb403c9fd1a6b07dd61a1e` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:13.815969 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=490ea5e772fb403c9fd1a6b07dd61a1e)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:13.817897 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:13.945708 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '490ea5e772fb403c9fd1a6b07dd61a1e', 'request_id': 'req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.951548 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '490ea5e772fb403c9fd1a6b07dd61a1e', 'request_id': 'req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:13.957691 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '490ea5e772fb403c9fd1a6b07dd61a1e', 'request_id': 'req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:14.047066 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] The token cache is being invalidate because project 490ea5e772fb403c9fd1a6b07dd61a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:44:14.047380 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:14.048003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-d9e03bd5-55ad-41e8-a6ad-c7bab7f6df7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:14.049583 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1414/2834] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:44:13 2022] DELETE /identity/v3/projects/490ea5e772fb403c9fd1a6b07dd61a1e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:14.055976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.055976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.055976 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.075059 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:14.076259 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:14.092490 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:14.134723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1421/2835] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:14.141730 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.142018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.142298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.160452 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:14.161742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:14.170501 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1415/2836] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:14.174579 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.187983 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8200028-62d5-40d7-98bb-2999eb5f2416 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.192847 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.193532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.193813 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.194090 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.194814 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:44:14.195116 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.197180 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.209319 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1422/2837] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:44:14.214128 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.223238 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ac7d8-6dc2-4820-a730-8b0f774cc815 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.228505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.229175 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.229460 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.229736 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.230421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.232331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.328659 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1416/2838] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:44:14 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:44:14.332624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.342825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb27946-4764-4444-932c-827f10ee939d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.395170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.395822 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.396100 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.396374 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.397080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.399448 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.458560 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1423/2839] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:44:14 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:44:14.463019 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.473322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35b33-a125-493f-9153-c3aabab087b4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.478508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.479148 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.479427 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.479700 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.480420 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.482027 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.492133 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1417/2840] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:44:14.495857 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.505477 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fbc74-0656-41a4-a31b-43ef35a9ca2d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.510066 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b568642-1e38-4d70-b6a3-c168f05596bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.510706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568642-1e38-4d70-b6a3-c168f05596bf admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.510992 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568642-1e38-4d70-b6a3-c168f05596bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.511264 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b568642-1e38-4d70-b6a3-c168f05596bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.511984 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b568642-1e38-4d70-b6a3-c168f05596bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.513581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b568642-1e38-4d70-b6a3-c168f05596bf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.523425 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1424/2841] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:44:14.528278 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.538256 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8bc10e-924c-4493-b72a-b38c8d4352b8 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.543339 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.544207 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.544489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.544823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] PATH_INFO: `/v3/projects/25182b95452140339377313d6ddadfb1/users/fbdce19adb46419caf4b875dc9981bf4/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.559406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=25182b95452140339377313d6ddadfb1, user_id=fbdce19adb46419caf4b875dc9981bf4, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.562097 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.624331 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1418/2842] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:44:14 2022] PUT /identity/v3/projects/25182b95452140339377313d6ddadfb1/users/fbdce19adb46419caf4b875dc9981bf4/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:14.639777 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.640070 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.640481 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.667387 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] MFA Rules not processed for user `fbdce19adb46419caf4b875dc9981bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:14.668581 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:14.731158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1425/2843] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:14.742241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:14.744004 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:14.766044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:14.800367 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdcc0c-a324-41dc-a148-12dd37ae90bf admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:14.803966 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f533453-74ab-4c5e-981f-2ccf064960a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21161c14bb024771be73ce9248ef515c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:14.804599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f533453-74ab-4c5e-981f-2ccf064960a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:14.804915 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f533453-74ab-4c5e-981f-2ccf064960a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:14.805192 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f533453-74ab-4c5e-981f-2ccf064960a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:14.813224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f533453-74ab-4c5e-981f-2ccf064960a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:14.814645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f533453-74ab-4c5e-981f-2ccf064960a3 service cinder] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:14.823924 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1419/2844] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:44:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:44:17.918723 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:17.937783 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:17.980886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f67a1-1c85-4e8c-b89f-79bb4b5c348a None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:17.985492 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:17.986358 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:17.986636 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:17.986907 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] PATH_INFO: `/v3/users/fbdce19adb46419caf4b875dc9981bf4` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:17.988132 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbdce19adb46419caf4b875dc9981bf4)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:17.990086 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:18.167525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbdce19adb46419caf4b875dc9981bf4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.168211 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbdce19adb46419caf4b875dc9981bf4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.244899 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbdce19adb46419caf4b875dc9981bf4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.252041 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbdce19adb46419caf4b875dc9981bf4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.252725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbdce19adb46419caf4b875dc9981bf4'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.269383 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1426/2845] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:44:17 2022] DELETE /identity/v3/users/fbdce19adb46419caf4b875dc9981bf4 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:18.273883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:18.274899 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:18.275044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:18.292574 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:18.293798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:18.350673 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1420/2846] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:18.360118 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:18.361537 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:18.416265 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d1c5d-0b41-4628-9547-41ec62ef8ef2 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:18.419883 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a76f5-7edb-4336-a1a6-c7b5bde43d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:18.420451 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a76f5-7edb-4336-a1a6-c7b5bde43d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:18.420827 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a76f5-7edb-4336-a1a6-c7b5bde43d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:18.421101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a76f5-7edb-4336-a1a6-c7b5bde43d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:18.429735 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a76f5-7edb-4336-a1a6-c7b5bde43d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:18.431161 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a76f5-7edb-4336-a1a6-c7b5bde43d9f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:18.440245 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1427/2847] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:44:18.831960 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:18.833369 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:18.847649 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fb3e0-5138-4526-90d2-2d60126f933f None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:18.857258 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:18.858451 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:18.858739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:18.859086 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] PATH_INFO: `/v3/projects/25182b95452140339377313d6ddadfb1` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:18.860435 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25182b95452140339377313d6ddadfb1)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:18.862252 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:18.958999 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25182b95452140339377313d6ddadfb1', 'request_id': 'req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.965032 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25182b95452140339377313d6ddadfb1', 'request_id': 'req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:18.971672 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25182b95452140339377313d6ddadfb1', 'request_id': 'req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:19.057844 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] The token cache is being invalidate because project 25182b95452140339377313d6ddadfb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:44:19.058129 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:19.058743 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-90e5cfa9-3ed0-4c1e-b889-56b50f3a7c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:44:19.060421 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1421/2848] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:44:18 2022] DELETE /identity/v3/projects/25182b95452140339377313d6ddadfb1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:19.065430 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.065915 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.066037 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.084524 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:19.085752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:19.118832 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:19.143293 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1428/2849] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:19.151621 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.151991 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.152336 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.170416 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:19.171622 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:19.179592 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1422/2850] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:19.183797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.193257 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f7f4-2d10-4f10-b4fc-68c76faa5b92 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.198742 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.199385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.199670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.199949 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.200710 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80422) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:44:19.201080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.202661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.214873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1429/2851] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:44:19.218977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.228181 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e075e-72c5-433f-a825-14b92c4cbe94 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.232717 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.233350 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.233628 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.233901 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.234595 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.236467 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.311041 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1423/2852] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:44:19 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:44:19.315149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.325877 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb5236-3db7-4bcb-a7aa-e907a67456c3 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.380507 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.381193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.381474 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.381748 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.382426 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.384836 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.487621 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1430/2853] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:44:19 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:44:19.491578 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.504883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a4bc7-71b0-4a2f-8b5a-1ffa8551c8a4 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.506907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.507552 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.507834 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.508113 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.509539 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.511115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.521364 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1424/2854] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:44:19.525129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.535081 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b34b63-4cf5-42d6-9ca9-c8751cca45fa admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.539752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda26453-a312-46d6-b015-6c5e2dbe7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.540406 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda26453-a312-46d6-b015-6c5e2dbe7baf admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.540725 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda26453-a312-46d6-b015-6c5e2dbe7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.541009 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda26453-a312-46d6-b015-6c5e2dbe7baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.541740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda26453-a312-46d6-b015-6c5e2dbe7baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.543335 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda26453-a312-46d6-b015-6c5e2dbe7baf admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.553435 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1431/2855] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:44:19.558053 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.567967 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4125f3-b66b-416a-96c4-8837ccc9fcc3 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.573500 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.574361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.574644 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.574921 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] PATH_INFO: `/v3/projects/e9f1cf792455410eb141a46d5584e127/users/35f330ed31c54729a39d73a35cb0d0b3/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.577170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:19.589566 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f1cf792455410eb141a46d5584e127, user_id=35f330ed31c54729a39d73a35cb0d0b3, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.592214 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.667665 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1425/2856] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:44:19 2022] PUT /identity/v3/projects/e9f1cf792455410eb141a46d5584e127/users/35f330ed31c54729a39d73a35cb0d0b3/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 20:44:19.672821 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dafd4d-d6fe-4ebe-b998-e14c34c5db69 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.673119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dafd4d-d6fe-4ebe-b998-e14c34c5db69 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.673404 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dafd4d-d6fe-4ebe-b998-e14c34c5db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.692143 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-c0dafd4d-d6fe-4ebe-b998-e14c34c5db69 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:19.693380 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-c0dafd4d-d6fe-4ebe-b998-e14c34c5db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:19.750670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1432/2857] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:19.760788 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:19.762568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:19.818814 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d5af-c7dc-4f51-a71a-a23d340c909e admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:19.823320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:19.823958 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:19.824240 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:19.824513 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:19.833823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:19.835285 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:19.844926 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1426/2858] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:44:25.012083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.012595 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.012728 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.039326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] MFA Rules not processed for user `35f330ed31c54729a39d73a35cb0d0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:25.041155 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:25.075931 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:25.105795 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1433/2859] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:25.110315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:25.120101 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65c5e-d0cd-41bf-9100-ea8a7e274d19 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:25.124599 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:25.125512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.125512 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.125772 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.126476 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:25.128351 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:25.237883 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1427/2860] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:44:25 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:44:25.242019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:25.253194 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d28a27-5cdb-4783-8bae-d512f8a18392 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:25.308324 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:25.309014 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.309300 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.309578 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] PATH_INFO: `/v3/users` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.310261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:25.312164 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:25.397246 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1434/2861] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:44:25 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:44:25.402011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:25.412303 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ee64-34e8-46bc-b418-5e5f23687f99 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:25.416815 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:25.417458 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.417741 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.418020 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.418742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:25.420357 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:25.432456 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1428/2862] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:44:25.436550 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:25.447548 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d19f9-cb0e-4435-992b-6a7ba1dc8f72 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:25.452313 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:25.453225 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.453510 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.453788 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] PATH_INFO: `/v3/projects/0e38fb0946084699bd551a0c2e654cab/users/7050a3738d30472ca1db661a8fa68eca/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.468533 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e38fb0946084699bd551a0c2e654cab, user_id=7050a3738d30472ca1db661a8fa68eca, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:25.471187 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:25.575394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1435/2863] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:44:25 2022] PUT /identity/v3/projects/0e38fb0946084699bd551a0c2e654cab/users/7050a3738d30472ca1db661a8fa68eca/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:25.577925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:25.588107 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6684b-957f-485d-9afa-fcf30b30141c admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:25.651753 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd4869-0628-4701-b61c-d4d056e479de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:25.652537 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd4869-0628-4701-b61c-d4d056e479de admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.652857 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd4869-0628-4701-b61c-d4d056e479de admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.653138 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd4869-0628-4701-b61c-d4d056e479de admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.653894 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd4869-0628-4701-b61c-d4d056e479de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:25.655505 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd4869-0628-4701-b61c-d4d056e479de admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:25.666739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1429/2864] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 20:44:25.670999 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:25.683659 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1642f-afb7-4f4a-b949-e12013a1fc3d admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:25.688962 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:25.689971 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:25.690359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:25.690760 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] PATH_INFO: `/v3/projects/0e38fb0946084699bd551a0c2e654cab/users/7050a3738d30472ca1db661a8fa68eca/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:25.693060 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e38fb0946084699bd551a0c2e654cab, user_id=7050a3738d30472ca1db661a8fa68eca, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:25.695792 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:25.708460 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1436/2865] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:44:25 2022] PUT /identity/v3/projects/0e38fb0946084699bd551a0c2e654cab/users/7050a3738d30472ca1db661a8fa68eca/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:44:31.074319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bf5af-dae4-4ed9-b2ce-43b526cfbf3c None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:31.074876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bf5af-dae4-4ed9-b2ce-43b526cfbf3c None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:31.074876 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2bf5af-dae4-4ed9-b2ce-43b526cfbf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:31.102627 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-eb2bf5af-dae4-4ed9-b2ce-43b526cfbf3c None None] MFA Rules not processed for user `7050a3738d30472ca1db661a8fa68eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:31.103851 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-eb2bf5af-dae4-4ed9-b2ce-43b526cfbf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:31.147170 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:31.178330 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1430/2866] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:31.189842 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:31.191701 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:31.252840 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372702ca-9c9d-44cb-87b4-e159911577a5 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:31.256399 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37174d8d343d4989a8c41b4d43246c0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:31.257076 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:31.257366 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:31.257642 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:31.301431 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:31.315908 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:31.317442 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:31.327303 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1437/2867] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:44:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:44:31.580228 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeba44-166c-40cf-a5a5-b47c09067c4f None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:31.580568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeba44-166c-40cf-a5a5-b47c09067c4f None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:31.580905 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeba44-166c-40cf-a5a5-b47c09067c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:31.601758 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-48aeba44-166c-40cf-a5a5-b47c09067c4f None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:31.603417 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-48aeba44-166c-40cf-a5a5-b47c09067c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:31.667026 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1431/2868] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:44:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:31.690124 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:31.691799 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:31.765068 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce068a90-38b6-4ee7-a3d0-b9095c2affbf service glance] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:31.770109 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc5eeb-ee97-451f-8a5e-8af6b1d5f988 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:31.770797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5eeb-ee97-451f-8a5e-8af6b1d5f988 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:31.771512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5eeb-ee97-451f-8a5e-8af6b1d5f988 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:31.771512 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc5eeb-ee97-451f-8a5e-8af6b1d5f988 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:31.780453 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc5eeb-ee97-451f-8a5e-8af6b1d5f988 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:31.782089 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbc5eeb-ee97-451f-8a5e-8af6b1d5f988 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:31.792708 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1438/2869] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:44:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:44:41.619289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:41.619799 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:41.619907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:41.637888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] MFA Rules not processed for user `35f330ed31c54729a39d73a35cb0d0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:41.639072 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:41.645985 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1432/2870] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:44:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:41.788939 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=40 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:44.957903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:44.958545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:44.958545 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:44.976717 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:44:44.978574 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:44:44.985948 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1439/2871] 10.222.0.65 () {58 vars in 1009 bytes} [Thu Jun 16 20:44:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:44:44.998406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:44:45.010735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2b96b-5b4d-41d0-861b-ba9467298283 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:44:45.015893 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:44:45.016607 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:44:45.016982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:44:45.017264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:44:45.026611 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:44:45.028140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:44:45.036400 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1433/2872] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:44:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:44:54.971527 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=3 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:44:55.033065 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=46 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:45:06.911661 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:45:06.966091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153c8c-11b6-4688-bac0-f86cbd409f12 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:45:06.969669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:45:06.970305 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:45:06.970589 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:45:06.970863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:45:06.980233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:45:06.981699 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:45:06.991224 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1440/2873] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:45:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:45:16.986812 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=26 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:45:41.681984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:45:41.691179 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d765e9-59b1-4fab-8572-0366623efcb4 service swift] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:45:41.694742 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:45:41.695361 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:45:41.695646 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:45:41.695916 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:45:41.697689 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:45:41.775804 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:45:41.777914 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:45:41.789149 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1434/2874] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:45:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:45:42.971826 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:45:42.981083 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5291b-c656-4932-b347-0efa85526af3 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:45:42.984771 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:45:42.987902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:45:42.987902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:45:42.987902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:45:42.987902 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:45:43.000797 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:45:43.002206 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:45:43.013806 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1441/2875] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:45:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 20:45:51.784407 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=34 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:45:53.008233 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:23.736760 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:23.749855 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e06568-5fa8-44ea-b094-1d7e692495f0 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:23.751528 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:23.752286 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:23.752657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:23.753003 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:23.755477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:23.773568 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:23.777182 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7959e36-add3-45b9-840c-2bc466e8b4b4 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:23.791791 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1435/2876] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:46:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:46:30.788034 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:30.789525 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:30.803987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ad145-b943-4286-8b1e-ebd86f2a336f service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:30.809472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:30.810097 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:30.810415 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:30.810757 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:30.812433 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:30.824045 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:30.826958 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:30.836282 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1442/2877] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:46:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:46:32.167588 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:32.168048 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:32.168159 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:32.186237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] MFA Rules not processed for user `8110296d70974b79a7b8d3847f290990`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:32.187430 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:32.194594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1436/2878] 10.222.0.65 () {58 vars in 967 bytes} [Thu Jun 16 20:46:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:46:32.234508 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:32.246452 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5760e0-5bbf-475d-bbfc-e88de9f0bd2b service nova] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:32.251310 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a73a2387e0164fc7936ae83eb81b818f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:32.251937 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:32.252218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:32.252598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:32.260494 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:32.262080 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:32.270201 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1443/2879] 10.222.0.65 () {60 vars in 1384 bytes} [Thu Jun 16 20:46:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 20:46:36.390338 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:36.391873 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:36.461812 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d75e64-8cb8-4b96-9240-532e4b883c46 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:36.466886 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:36.467529 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:36.467872 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:36.468092 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:36.470438 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:36.481657 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:36.483224 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:36.493786 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1437/2880] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:46:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:46:39.998024 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:40.011756 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f9a46-bdfe-49ae-ba31-1d25bec0cd62 service swift] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:40.017838 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:40.018677 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:40.019102 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:40.019476 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:40.021598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:40.034290 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:40.036141 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:40.048289 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1444/2881] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:46:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:46:40.152925 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:40.216454 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913fb98-f153-42a9-9c4d-359b71506d47 service placement] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:40.221459 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:40.222320 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:40.222603 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:40.222881 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] PATH_INFO: `/v3/users/35f330ed31c54729a39d73a35cb0d0b3` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:40.224056 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f330ed31c54729a39d73a35cb0d0b3)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:40.226018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:40.449443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f330ed31c54729a39d73a35cb0d0b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:40.461244 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f330ed31c54729a39d73a35cb0d0b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:40.461900 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f330ed31c54729a39d73a35cb0d0b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:40.467197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:40.469040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f330ed31c54729a39d73a35cb0d0b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:40.563593 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f330ed31c54729a39d73a35cb0d0b3'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:40.570142 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1438/2882] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:46:40 2022] DELETE /identity/v3/users/35f330ed31c54729a39d73a35cb0d0b3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:40.799069 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:40.809738 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f8cc4-88b2-40c0-b693-af618278c5df service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:40.867340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:40.868229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:40.868536 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:40.868824 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] PATH_INFO: `/v3/projects/e9f1cf792455410eb141a46d5584e127` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:40.870036 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f1cf792455410eb141a46d5584e127)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:40.872029 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:40.974278 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f1cf792455410eb141a46d5584e127', 'request_id': 'req-664a7216-ecf2-4618-b042-7802daf998f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:40.980272 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f1cf792455410eb141a46d5584e127', 'request_id': 'req-664a7216-ecf2-4618-b042-7802daf998f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.057707 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f1cf792455410eb141a46d5584e127', 'request_id': 'req-664a7216-ecf2-4618-b042-7802daf998f0'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.068056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] The token cache is being invalidate because project e9f1cf792455410eb141a46d5584e127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:46:41.073860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.073860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.073860 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1445/2883] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:46:40 2022] DELETE /identity/v3/projects/e9f1cf792455410eb141a46d5584e127 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:41.074688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:41.076443 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:41.089223 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae21f5d-3315-490b-8255-23bd27019f75 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:41.145137 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:41.145998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:41.146279 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:41.146555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] PATH_INFO: `/v3/users/7050a3738d30472ca1db661a8fa68eca` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:41.147739 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7050a3738d30472ca1db661a8fa68eca)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:41.149687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:41.362943 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7050a3738d30472ca1db661a8fa68eca'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.374353 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7050a3738d30472ca1db661a8fa68eca'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.375014 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7050a3738d30472ca1db661a8fa68eca'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.381723 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7050a3738d30472ca1db661a8fa68eca'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.463265 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-2ad057f5-c900-4f2d-a1fb-c3b5312013a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7050a3738d30472ca1db661a8fa68eca'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.469309 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1439/2884] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:46:41 2022] DELETE /identity/v3/users/7050a3738d30472ca1db661a8fa68eca => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:41.716706 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:41.718176 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:41.740350 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a7216-ecf2-4618-b042-7802daf998f0 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:41.796400 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:41.806042 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:41.808897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:41.808897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:41.808897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] PATH_INFO: `/v3/projects/0e38fb0946084699bd551a0c2e654cab` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:41.808897 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e38fb0946084699bd551a0c2e654cab)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:41.810534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:41.949669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e38fb0946084699bd551a0c2e654cab', 'request_id': 'req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:41.956602 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e38fb0946084699bd551a0c2e654cab', 'request_id': 'req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:42.031834 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e38fb0946084699bd551a0c2e654cab', 'request_id': 'req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:42.042638 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] The token cache is being invalidate because project 0e38fb0946084699bd551a0c2e654cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80422) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:46:42.043039 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:42.043666 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-c4ac5e9f-0559-4f6c-ac33-490f444ac28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:46:42.045249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1446/2885] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:46:41 2022] DELETE /identity/v3/projects/0e38fb0946084699bd551a0c2e654cab => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:42.050344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.050632 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.050907 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.069130 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:42.070390 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:42.129662 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1440/2886] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:46:42.137975 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.138472 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.138582 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.156421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:42.157683 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:42.165608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1447/2887] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:46:42.169668 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.179637 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc309ba-0956-4fd6-8c39-262527f24181 None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.184329 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.185038 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.185319 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.185594 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.186340 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80421) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 20:46:42.186645 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.188874 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.191205 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:42.202639 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1441/2888] 10.222.0.65 () {58 vars in 1152 bytes} [Thu Jun 16 20:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 20:46:42.205739 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.214770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef1841-8772-4ac7-b184-3ae8da58bfbf None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.219521 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.220237 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.220561 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.220873 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.221571 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.223478 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.319229 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1448/2889] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:46:42 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:46:42.323470 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.333998 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77397003-d9dd-4bd7-8d4c-65772f1ea567 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.389559 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.390227 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.390485 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.390759 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.391477 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.393406 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.472562 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1442/2890] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:46:42 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:46:42.476351 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.487227 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe105c-ee47-4c80-a42b-d846d234bc22 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.491770 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.492414 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.492732 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.493056 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.493778 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.495347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.505740 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1449/2891] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:46:42.509587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.519211 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15835c8d-52a9-442f-9176-14b18b08318d admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.523737 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e92ca2-dffa-4461-a4b2-0909a4c3e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.524373 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e92ca2-dffa-4461-a4b2-0909a4c3e4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.524686 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e92ca2-dffa-4461-a4b2-0909a4c3e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.524965 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e92ca2-dffa-4461-a4b2-0909a4c3e4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.525681 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e92ca2-dffa-4461-a4b2-0909a4c3e4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.527241 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e92ca2-dffa-4461-a4b2-0909a4c3e4c6 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.537312 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1443/2892] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:46:42.541285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.551818 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c9991-c9ee-4844-9fae-ed61e626ec85 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.556454 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.557367 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.557651 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.557932 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] PATH_INFO: `/v3/projects/6b0dafbf350a4d169d9c9a78dfbeb790/users/183802500dac471cb69e2498377d18ae/roles/ebb073838eae41259f93a5ed2bc31346` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.572158 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0dafbf350a4d169d9c9a78dfbeb790, user_id=183802500dac471cb69e2498377d18ae, role_id=ebb073838eae41259f93a5ed2bc31346)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.574798 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.648796 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1450/2893] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:46:42 2022] PUT /identity/v3/projects/6b0dafbf350a4d169d9c9a78dfbeb790/users/183802500dac471cb69e2498377d18ae/roles/ebb073838eae41259f93a5ed2bc31346 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:42.654264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc48865-d52a-4cca-827a-dc99acda5cb1 None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.654554 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc48865-d52a-4cca-827a-dc99acda5cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.654831 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc48865-d52a-4cca-827a-dc99acda5cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.673445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-efc48865-d52a-4cca-827a-dc99acda5cb1 None None] MFA Rules not processed for user `d83b7d0e898a4c67b76bf60bd5d5825e`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:42.674640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-efc48865-d52a-4cca-827a-dc99acda5cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:42.734237 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1444/2894] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:46:42.744326 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:42.746062 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:42.801119 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d7d78-11b8-4308-974f-a7e64ee16458 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:42.804705 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:42.805340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:42.805670 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:42.805947 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:42.814682 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:42.816082 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:42.825274 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1451/2895] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:46:47.865140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:47.865683 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:47.865981 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:47.901264 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.auth.core [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] MFA Rules not processed for user `183802500dac471cb69e2498377d18ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80421) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:47.902920 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:47.980888 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1445/2896] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:46:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:46:47.985608 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:47.996805 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809e6c3-259f-4101-bbcf-267b340a3736 service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:48.001943 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:48.003340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:48.003752 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:48.004129 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:48.004982 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:48.006987 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:48.083465 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:48.094831 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1452/2897] 10.222.0.65 () {60 vars in 1152 bytes} [Thu Jun 16 20:46:47 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 20:46:48.096322 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:48.103134 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:48.107266 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1569d2-565e-4e9c-9ed8-b87af3ee66bb None None] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:48.167403 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:48.168289 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] REQUEST_METHOD: `POST` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:48.168687 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:48.168979 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] PATH_INFO: `/v3/users` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:48.173661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:48.173661 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:48.298494 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1446/2898] 10.222.0.65 () {60 vars in 1143 bytes} [Thu Jun 16 20:46:48 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 20:46:48.302668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:48.312784 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ba8e6-add9-4876-923d-6a1df0156c0b admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:48.317630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:48.318338 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:48.318623 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:48.318900 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:48.319624 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:48.321239 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:48.332532 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1453/2899] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:46:48.336642 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:48.347422 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157f732-c009-4c2d-a421-d3d6f6374688 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:48.351982 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:48.352891 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:48.356984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:48.356984 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] PATH_INFO: `/v3/projects/3ea0f373011f4943bfe7019eec6d1856/users/3a1b0c11c6764cce8cab9fa69436b5ca/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:48.368044 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea0f373011f4943bfe7019eec6d1856, user_id=3a1b0c11c6764cce8cab9fa69436b5ca, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:48.371273 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:48.448931 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1447/2900] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:46:48 2022] PUT /identity/v3/projects/3ea0f373011f4943bfe7019eec6d1856/users/3a1b0c11c6764cce8cab9fa69436b5ca/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:48.453055 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:48.463627 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d1407-b6b1-48ef-bd5b-9ccfd47a3734 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:48.521057 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4bc6b-8940-444e-adae-3c7c297ff012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:48.521722 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4bc6b-8940-444e-adae-3c7c297ff012 admin admin] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:48.522010 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4bc6b-8940-444e-adae-3c7c297ff012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:48.522285 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4bc6b-8940-444e-adae-3c7c297ff012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:48.523002 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4bc6b-8940-444e-adae-3c7c297ff012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:48.524570 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4bc6b-8940-444e-adae-3c7c297ff012 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:48.534779 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1454/2901] 10.222.0.65 () {58 vars in 1121 bytes} [Thu Jun 16 20:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 20:46:48.539040 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:48.549463 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff574e66-e3a8-48db-94f5-8d20112df205 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:48.554061 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:48.554936 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:48.555216 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:48.555489 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] PATH_INFO: `/v3/projects/3ea0f373011f4943bfe7019eec6d1856/users/3a1b0c11c6764cce8cab9fa69436b5ca/roles/c58525d5c30b4bd58cc4150c24ac8d68` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:48.557502 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea0f373011f4943bfe7019eec6d1856, user_id=3a1b0c11c6764cce8cab9fa69436b5ca, role_id=c58525d5c30b4bd58cc4150c24ac8d68)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:48.560125 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:48.570980 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1448/2902] 10.222.0.65 () {60 vars in 1482 bytes} [Thu Jun 16 20:46:48 2022] PUT /identity/v3/projects/3ea0f373011f4943bfe7019eec6d1856/users/3a1b0c11c6764cce8cab9fa69436b5ca/roles/c58525d5c30b4bd58cc4150c24ac8d68 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:46:54.093222 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a158d0-d3bc-413a-be67-f45a9f66bc2e None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:54.093811 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a158d0-d3bc-413a-be67-f45a9f66bc2e None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:54.093920 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a158d0-d3bc-413a-be67-f45a9f66bc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:54.124309 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-f3a158d0-d3bc-413a-be67-f45a9f66bc2e None None] MFA Rules not processed for user `3a1b0c11c6764cce8cab9fa69436b5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:54.125619 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-f3a158d0-d3bc-413a-be67-f45a9f66bc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:54.201669 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1455/2903] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:46:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:46:54.217658 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:46:54.220180 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:54.298358 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d69756-5cab-423c-b24d-38b2720a4b63 admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:46:54.304074 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:46:54.304771 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:54.305058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:54.305344 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:54.366035 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:46:54.370094 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:46:54.371713 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:46:54.381169 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1449/2904] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:46:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:46:56.992513 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] REQUEST_METHOD: `POST` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:46:56.993101 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:46:56.993220 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:46:57.012336 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.auth.core [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] MFA Rules not processed for user `183802500dac471cb69e2498377d18ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80422) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 20:46:57.013603 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:46:57.020886 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1456/2905] 10.222.0.65 () {58 vars in 957 bytes} [Thu Jun 16 20:46:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 20:47:04.437172 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=3 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:47:07.005688 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=72 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:47:12.012695 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:47:12.067930 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7baf-784b-4981-9013-cd74e35f0446 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:47:12.071587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:47:12.072231 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:47:12.072520 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:47:12.072829 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:47:12.074620 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:47:12.084733 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:47:12.086160 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:47:12.094710 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1450/2906] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:47:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:47:13.795175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:47:13.795175 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:47:13.865359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fcbb7-b30d-43f1-9c9f-30b0a75e7c35 None None] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:47:13.870340 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:47:13.870986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:47:13.871297 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:47:13.871573 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:47:13.873346 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:47:13.884523 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:47:13.886103 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:47:13.896528 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1457/2907] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:47:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:47:22.090558 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=26 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:47:23.892112 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=32 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:47:26.849183 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:47:26.857735 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045e5e1-b2b8-4450-9439-7dc676bce32b service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:47:26.862508 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:47:26.863220 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:47:26.863504 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:47:26.863781 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:47:26.873738 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:47:26.875197 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:47:26.884688 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1451/2908] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:47:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:47:36.880530 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:48:56.050347 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:48:56.053447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:48:56.134863 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34875f2-f761-40f3-87ce-ae698fa2ab51 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:48:56.139961 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:48:56.140598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:48:56.140909 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:48:56.141193 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:48:56.142959 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:48:56.154149 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:48:56.155743 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:48:56.165534 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1458/2909] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:48:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:49:06.161260 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=37 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:49:32.031555 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:49:32.060798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862a6f7-fb7a-4070-ba39-dda2169d1232 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:49:32.064098 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:49:32.065059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:49:32.065059 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:49:32.065324 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:49:32.067147 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:49:32.090647 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:49:32.092136 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:49:32.100294 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1452/2910] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:49:32.182580 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:49:32.191898 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee907c41-2ff0-4941-8386-19ac44de78f1 service placement] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:49:32.196138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:49:32.196807 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:49:32.197091 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:49:32.197370 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:49:32.199138 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:49:32.230394 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:49:32.231800 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:49:32.252261 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1459/2911] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:49:34.390298 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:49:34.391490 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:49:34.407711 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c688b-3d07-4dae-8b21-297f6f0ee64a service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:49:34.413112 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7be4c89082ac47d786cf7e1821ed01b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:49:34.413765 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:49:34.414043 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:49:34.414315 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:49:34.416156 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:49:34.428798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:49:34.430682 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:49:34.442869 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1453/2912] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:49:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:49:42.249650 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=18 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:49:44.436821 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=26 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:50:51.799969 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:50:51.811844 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b353e-9517-449c-b1ad-0c5c2478b4ba service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:50:51.815825 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:50:51.816489 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:50:51.816815 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:50:51.817286 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:50:51.819903 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:50:51.834839 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:50:51.836307 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:50:51.849447 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1460/2913] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:50:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:50:53.029570 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:50:53.038953 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee518e8-8f21-4909-b146-28d315b8f858 service nova] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:50:53.042587 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '046675b504304fb6991ff823ef931802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:50:53.043226 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:50:53.043509 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:50:53.043787 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:50:53.045616 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:50:53.062363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:50:53.062363 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:50:53.073445 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1454/2914] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:50:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:51:01.844170 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=6 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:51:02.762930 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:51:02.841401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac07407-3868-4d74-ae27-a1d3105ccc2c service neutron] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:51:02.845802 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:51:02.846674 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:51:02.846944 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:51:02.847218 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] PATH_INFO: `/v3/users/183802500dac471cb69e2498377d18ae` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:51:02.848385 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183802500dac471cb69e2498377d18ae)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:51:02.850986 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:51:03.042712 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183802500dac471cb69e2498377d18ae'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.043359 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183802500dac471cb69e2498377d18ae'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.067343 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=6 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:51:03.114504 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183802500dac471cb69e2498377d18ae'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.122401 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183802500dac471cb69e2498377d18ae'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.123998 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183802500dac471cb69e2498377d18ae'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.140019 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1461/2915] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:51:02 2022] DELETE /identity/v3/users/183802500dac471cb69e2498377d18ae => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:51:03.385889 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:51:03.396462 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adac3e-6455-46d2-a0fd-ad78b69d36a6 service neutron] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:51:03.452054 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:51:03.452977 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:51:03.453376 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:51:03.453655 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] PATH_INFO: `/v3/projects/6b0dafbf350a4d169d9c9a78dfbeb790` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:51:03.454823 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0dafbf350a4d169d9c9a78dfbeb790)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:51:03.456773 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:51:03.571598 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0dafbf350a4d169d9c9a78dfbeb790', 'request_id': 'req-bf8bbf29-3362-445d-9ffc-023316f9958a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.577577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0dafbf350a4d169d9c9a78dfbeb790', 'request_id': 'req-bf8bbf29-3362-445d-9ffc-023316f9958a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.583640 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0dafbf350a4d169d9c9a78dfbeb790', 'request_id': 'req-bf8bbf29-3362-445d-9ffc-023316f9958a'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.668729 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] The token cache is being invalidate because project 6b0dafbf350a4d169d9c9a78dfbeb790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:51:03.669018 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.669631 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.671163 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1455/2916] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:51:03 2022] DELETE /identity/v3/projects/6b0dafbf350a4d169d9c9a78dfbeb790 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:51:03.675437 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:51:03.676904 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:51:03.689970 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7d84b-c8dd-4711-8866-0ddde47d8404 admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:51:03.748021 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:51:03.748925 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:51:03.749212 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:51:03.749493 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] PATH_INFO: `/v3/users/3a1b0c11c6764cce8cab9fa69436b5ca` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:51:03.750698 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a1b0c11c6764cce8cab9fa69436b5ca)` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:51:03.752598 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:51:03.755421 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:51:03.952312 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a1b0c11c6764cce8cab9fa69436b5ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:03.953075 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a1b0c11c6764cce8cab9fa69436b5ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.024668 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a1b0c11c6764cce8cab9fa69436b5ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.032254 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a1b0c11c6764cce8cab9fa69436b5ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.032941 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.notifications [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a1b0c11c6764cce8cab9fa69436b5ca'} {{(pid=80422) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.049849 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1462/2917] 10.222.0.65 () {58 vars in 1223 bytes} [Thu Jun 16 20:51:03 2022] DELETE /identity/v3/users/3a1b0c11c6764cce8cab9fa69436b5ca => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:51:04.310473 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Authenticating user token {{(pid=80421) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:51:04.311947 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.fernet_utils [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80421) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:51:04.325696 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bbf29-3362-445d-9ffc-023316f9958a admin admin] Validating token access rules against request {{(pid=80421) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:51:04.380706 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd83b7d0e898a4c67b76bf60bd5d5825e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6923572ff9f4b66867148d1a4dea898', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80421) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:51:04.381577 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:51:04.382584 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:51:04.382909 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] PATH_INFO: `/v3/projects/3ea0f373011f4943bfe7019eec6d1856` {{(pid=80421) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:51:04.384140 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea0f373011f4943bfe7019eec6d1856)` {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:51:04.386115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] RBAC: Authorization granted {{(pid=80421) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:51:04.408798 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:51:04.493843 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea0f373011f4943bfe7019eec6d1856', 'request_id': 'req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.499123 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea0f373011f4943bfe7019eec6d1856', 'request_id': 'req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.505058 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea0f373011f4943bfe7019eec6d1856', 'request_id': 'req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7'} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.618822 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] The token cache is being invalidate because project 3ea0f373011f4943bfe7019eec6d1856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80421) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 20:51:04.619115 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.619779 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG keystone.notifications [None req-55dffa28-90af-4a9f-a473-4fd6bda3a3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80421) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 20:51:04.621365 dv-cinder-819149-6-smb devstack@keystone.service[80421]: [pid: 80421|app: 0|req: 1456/2918] 10.222.0.65 () {58 vars in 1232 bytes} [Thu Jun 16 20:51:04 2022] DELETE /identity/v3/projects/3ea0f373011f4943bfe7019eec6d1856 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 20:51:14.046292 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:51:14.615011 dv-cinder-819149-6-smb devstack@keystone.service[80421]: DEBUG dbcounter [-] [80421] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80421) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 20:54:01.029495 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Authenticating user token {{(pid=80422) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 20:54:01.030880 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:54:01.098664 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04303dc6-ca18-4d51-b864-86ef9a576bee admin admin] Validating token access rules against request {{(pid=80422) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 20:54:01.157753 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31897a7b7dda4dc1be1ee7a0d32bdd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '87cfcb21b7554cb0b5a7a8e3a20fb149', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80422) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 20:54:01.158409 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] REQUEST_METHOD: `GET` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 20:54:01.158689 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] SCRIPT_NAME: `/identity` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 20:54:01.158966 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80422) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 20:54:01.164630 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.fernet_utils [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80422) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 20:54:01.172249 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 20:54:01.173845 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be98aeb-2475-40df-843a-3e70d8b47853 service placement] RBAC: Authorization granted {{(pid=80422) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 20:54:01.184369 dv-cinder-819149-6-smb devstack@keystone.service[80422]: [pid: 80422|app: 0|req: 1463/2919] 10.222.0.65 () {60 vars in 1365 bytes} [Thu Jun 16 20:54:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 20:54:11.180033 dv-cinder-819149-6-smb devstack@keystone.service[80422]: DEBUG dbcounter [-] [80422] Writing DB stats keystone:SELECT=58 {{(pid=80422) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}